Love & Mrs. Sargent - Dennis, Patrick 1921-1976 ([United States Farrar, Straus & Giroux], 1961)
Originally published under the pseudonym Virginia Rowans.
"A Manor book"