Mount Fitzwilliam comprises the official residence of the Governor-General as well as the office of the Governor-General.  The ten-acre estate is named for a former owner - Richard Fitzwilliam - who was Governor from 1733 to 1738.  The site was purchased by The Crown in 1800 for four thousand pounds, sterling (£4,000).

The Governor-General is the representative of the British Monarch who is the head of The Commonwealth of Nations, of which The Bahamas is a Member State.  The Governor-General lives and works at Mount-Fitzwilliam.

The mansion has undergone many changes over the years.  The original structure was built during the administration of John Halkett, who served as Governor from 1801 to 1804.

In 1907, the East Wing was added to house the offices (ground floor) and Grand Ballroom (upstairs).  Badly damaged by a hurricane, the East Wing was replaced by a new structure in 1909.

Substantial damage to the mansion, caused by the hurricane of 1929, led to it rebuilding.  Retaining the original, solid, outside walls, the new structure was given a new facade, including a carport, as well as improved entry and hallways.  It was ready for occupancy by Governor Sir Bede and Lady Clifford in 1932.

Additional quarters in the West Wing (now known as the Windsor Wing) were constructed to accommodate the personal staff of the Duke of Windsor, formerly King Edward VII of Great Britain, and Governor of The Bahamas from 1940 to 1944.

During 1964 considerable renovation was carried out, at which time the office accommodation on the ground floor of the East Wing was also remodelled.

In 1977 the roof of the Patio on the south side of the building was added to facilitate the accommodation for the visit of Her Majesty Queen Elizabeth II in October that year.