I would never take the builders/construction company's opinion on a tree. Get a second opinion if you can't decide for yourself. A better tree is going to take a long time to mature. Also, construction could lead to root damage and cause the tree to go into decline or lose limbs.
Even then I would be sceptical. If they know what they're talking about then they know exactly how little most construction companies seem to know about trees.