"Everyone knows what a horse is"

I just assume it's a random doodad. Like a desk decoration or something. Why wouldn't ancient people have had dumb bullshit that served no purpose other than it's aesthetic value just like we do now?