Also known as Savage’s Castle, it was probably built soon after the Anglo-Norman invasion of Ulster in 1177, when William Le Savage, the founder of the dynasty was among John de Courcy’s knights. The Savages, who were Lords of Little Ards, enjoyed a good relationship with the Montgomery family following the Plantation of 1606. In 1623 Patrick Savage, who was said to be the first Protestant in the family, married Sir Hugh Montgomery’s daughter Jane. Her brother, Sir James Montgomery, restored the then ruined castle for them, adding a joint Montgomery/Savage coat of arms (which can now be seen on Portaferry House). The Savages lived here until 1760, when Andrew Savage built the first Portaferry House.