The story
This phrase derives from the reference to the potter's field in the New Testament, Matthew 27:7. After Judas Iscariot committed suicide and left the 30 pieces of silver from betraying Jesus, the chief priest use the money to purchase a potter's field to bury gentiles.
Etymology from Wiktionary, CC BY-SA 4.0.