Is it fair to veto this trade?

I agree with you. It is not fair to veto this kind of trade. Vetoes should only be used where there is an obviously lopsided trade where it looks like a weak team is trading its remaining good players to a team that is already strong. In all other scenarios I would let the trade go through.