In a nutshell, we are in the way of nature doing it's stuff, the sand and soil being washed away from the coastline would end up somewhere else to replenish that are from what I get. Just that man made structure along the way would get destroyed and putting barriers would cause surrounding area to erode at a faster pace.