The joke is about the bin/ directory on Linux, which contains the binaries of the system (also called executables) which can break the system if you delete it, and also refer to the paper bin where all your trash files go and people tend to delete usually.
Could also be referring to something like ~/.local/bin, where you remove unnecessary user-only programs vs. /use/bin where you remove system essential ones.