If I'm remembering it right, the Entwives preferred to garden, whereas the Ents preferred thing wild and untamed* so they both lived in different parts and visited each other. Then one day then Ents visited to find only barren lands where the gardens had been. The Ents searched but never found out what happened.
* which would make the Entwives more authoritarian, right?