James inherited a Sussex estate and a fortune at four years old and spent both on other people's work. Through the thirties he was the most significant private patron Surrealism had in Britain: he financed the Paris journal Minotaure, bought from René Magritte, Leonora Carrington and Leonor Fini, and in the summer of 1936 signed a contract with Salvador Dalí that gave him virtually everything Dalí produced until the end of 1938 in exchange for an allowance.
The Lobster Telephone and the Mae West Lips Sofa were made under that contract, for his own houses. He also arranged Dalí's introduction to Sigmund Freud and sat through the meeting on 19 July 1938. He published poetry throughout, was taken less seriously for it than he wanted to be, and spent his last decades building Las Pozas, a concrete Surrealist garden in the Mexican rainforest.