The topic of low altitude flying and beat-ups (high speed, low level passes) comes up on a nearly weekly basis on a general aviation forum I frequent.
There are two well defined groups who each defend their position with passion.
The first group insists that low level flying is 100% safe if done correctly by someone experienced while the second group insists that the closer to the ground one flies the higher the risk regardless of skill level.

Invariably every few months there is another fatal accident which removes someone from the first group. The chatter online nearly always points out that the deceased was an experienced and low risk pilot. I've lost count of the fatalities due to flights into power lines, beat-ups with wing over manoeuvres into the ground, etc.
Clearly the closer one flies to the ground, the less time and space there is for recovery regardless of skill level.
The further I stay away from that dead man's zone the better. The air space between the ground and 1000 feet AGL is strictly reserved for takeoffs and landings in my book.