The story
From up + north. The sense 2 comes from the fact that that in New York state many prisons are located in the northern part of the state.
Etymology from Wiktionary, CC BY-SA 4.0.
up north
Today it means: In the northern part of an area, country etc. Full definition →