Not Ivy, but definitely part of the mix during the latter part of the 1950s: 'Adrift In Soho' etc.  A pity really that he had to move to Cornwall, reinvent himself and begin writing endless crappy paperbacks about UFOs and suchlike.  But: the hair, the glasses, the polo neck...