A wall that high is going to mess with their farming in several ways, particularly by limiting the amount of sunlight their crops receive.
More importantly, the single opening in the front will channel water into the village at higher velocities and leave them no means of escape. Everyone could easily drown in there.