Architecture wise it's not an amazing build. I wanted to show it off because I want to others take off with this concept. All the villagers are controlled via a large number of command blocks. The blocks are coded for each individual villager. I tried to hint as to what the town was like and how the villagers interacted through name, custom item, and NBT tags. If I want too I can add vendors for items from mods too.
Originally I was going to have a mass set-up that had a day set of villagers and night set of villagers but I couldn't get it to work right.