The story
From goose + berry. It is possible that the first element was originally something related to the gros- of French groseille and/or the kruis- of Dutch kruisbes but has been altered by folk etymology.
Etymology from Wiktionary, CC BY-SA 4.0.