The story
Apparently originating from the southern United States, the phrase may refer to a hunting dog that refuses to do its job.
Etymology from Wiktionary, CC BY-SA 4.0.
that dog won't hunt
Today it means: That idea will not work; that is an inadequate explanation or proposition. Full definition →