The area of Chowder Bay was used for a whaling industry and the whales would make fish chowder from the oysters and pipis found in this bay.
In 1832, a wealthy American whaler named Captain Cliffe purchased the Government Gardens and built a home called Cliffeton. Hence the name, Clifton Gardens.
As a result of the increasing numbers of day excursionists to Chowder Bay there was an improvement to the facilities in Clifton Gardens that included a huge pavilion. So, in 1920 an upper deck and a lower deck was constructed which was fantastic for jumping or diving off into the shark proof enclosure.