pillager side -
The villagers would Be Running from you and not trading you
iron golems will attack you
Pillagers will not attack you
will kill hostile mobs (Zombies,Skeletons,Endermans)
--------------
villager side -
there's would be more Pillagers trying to attack the village
the villagers traders will be more cheaper
you will be the hero of village
------------
that's is my idea