Emergency services are pleading with locals and visitors to take care when the coastline following a recent cliff collapse.