I guess that they just don't come to mind as "core" Ivy in the way that OCBDs, soft shoulders and weejuns do, and (mistakenly perhaps) I tend to think of them as distinctly British rather than US in origin.  But it's a knee-jerk reaction rather than anything thought out on my part.