When the Town Mill was built in 1340 it probably consisted of just one mill building, with two waterwheels on the outside of the north wall driving the milling equipment inside. However, a steady stream of additions over the years has left us with a complex of buildings grouped around a central cobbled courtyard. All these buildings have now been refurbished and put back into productive use.

The working mill remains in its original location, with the waterwheel, rather unusually, inside the building, where it has been located since about 1797. The Miller's garden lies at the western end  of the mill site. The Miller's house, added in 1661, now houses the mill shop, as well as a community/class room and the Mill offices. In 2005 a modern bakery was established in the old cart shed beside the miller's house.

On the southern side of the courtyard, the café/restaurant, two art galleries and an attic craft studio now occupy the old Victorian bakery building. Finally, a working pottery and frame-making studio have been established in what was the old stable block of the Victorian mill.