Campaigners have united to oppose plans for sea defences that would protect more than 100 homes and businesses in their village.