Yes!

For example, I like layering, but this preppy thing about wearing four or five polo shirts or button downs? An affectation, isn't it?

Yes,"less is more", but only if "less" is the best.
In other words, with the old Brooks Brothers quality, less was more.

I go with the old Brooks as far as possible.  Press (for example) stand a fair way behind.  I am increasingly fond of London Fog: honest, straightforward, inexpensive.  Vintage Alan Paine for knitwear.  Colours: mainly navy, pale blue, shades of dark green, shades of grey.  Less in the way of maroon nowadays.  Charcoal and some fawn, but limited.  Bottle green cords from Paul Stuart, Bean for jeans, Woolrich for warmth.  I quite likely own less than anyone else on 'Talk Ivy'.

I've told this story before -

I was waaaay overdresed when I had my Ivy Shop 'interview' with Ian Strachan. He was just in his habitual Levis, Sebagos, Brooks Shirt & Alan Paine...

So then for my first working day I pulled it all right back to just Bass, Levis Chinos, Troy Shirt & a Heavy ribbed Navy 'Fishermans' style sweater from M&S. Mr Lally wasn't too different either, only he wore Tweed trousers & a Lambswool Crewneck up top with his Sebagos.

During the afternoon John Simons rang up & Ian told him he had one of his customers with him - "He looks the part" was the verdict & I was a very happy boy, despite Ian forgetting my name.

Ian called Chions 'Cottons' by the way. Just  thought I'd share that.

Less was more.

I try to impose certain rules upon myself: fibres, provenance, colour: in no particular order.  But, in principle, it must be cotton, wool or cashmere.  I find it makes life easier.