Is my impression correct that in the U.S. many if not most fly around
with handheld radios only?
If yes - why?

In (continental) Europe virtually all sailplanes have built-in radios.