Looking for a beautiful small town in the Swiss lake area as a base for leisurely travel, maybe Grindelwald or Brienz?

We don't plan on doing extensive hiking, just on wandering through the small towns near the lakes and enjoying nature and local atmosphere. I like the fact that Brienz is right on the lake and love the idea of the lake views. However everyone seems to recommend Grindelwald and no-one ever mentions Brienz, wondering if there is a reason not to consider Brienz.