The thirteen-acre original site was first purchased by New Westminster businessman Frederick Hart in 1906. Mr. Hart named the property "Avalon", after his birthplace. A leading architect of the day, Frank Macey, designed the Tudor Revival building as it stands today. The style is characterized by a
flat-roofed central square tower, steep gables and leaded
glass windows.

The Montague Moore family moved in during 1916. Ethel Moore soon became renowned for her spectacular iris gardens, and the estate, now known as "Rosedale Gardens", was visited by flower lovers from across the country who came to purchase cut flowers and bulbs. In a single year Mrs. Moore grew more than 300 varieties of the bearded iris alone.

In 1950 the Moores sold the estate to Ralph Baker, a Standard Oil company executive. He instituted a program of modernization and improvement. The large living room was completed and the property renamed "Deerfield." The Charles Riley family purchased the estate in the mid-1950s and continued to modernize the stately old home.

The Corporation of the District of Burnaby purchased the property in 1979. For eight years it was occasionally used by moviemakers, serving as a location for films starring such well-known personalities as Bette Davis and James Brolin. At the end of this time the District considered the prospect of opening a restaurant at the estate. Paul Smolen, Hart House's current owner, was one of three original partners approached by the District. The partners recognized that the stately house and grounds presented a unique opportunity to create a premier culinary destination. They opened Hart House in 1988. In 2000 Paul Smolen bought out his partners and Carol Smolen came onboard. Hart House’s combination of magnificent setting, outstanding cuisine and warm, friendly service continues to enchant guests and reviewers alike.