The wikipedia article describes it as possibly being a riddle about an egg, where the answer became so widely known that it ceased to work as a riddle.
Alternate theories of the origins include various historical figures, a siege engine, and a cannon.