Standing strong for hundreds of years, military defences and coastal buildings are at risk of falling away to history.