Most of the stones were used for local buildings once the Romans left Britain and the Wall became derelict.