The house was the site of an annual art auction that drew performers like Diana Ross and Barry Manilow.