Legal vs. practical cloud cover for VFR

At what point does VFR become too troublesome to be practical, in terms of
cloud cover? VFR only requires that one stay a certain distance away from
clouds, but it doesn't impose any limit on the number or proximity of clouds
in the sky (unless they are so close together that one cannot maintain the
required clearance). Nevertheless, it seems to me that at some point the
clouds are so numerous and close together that flying VFR becomes more of an
irritation than a pleasure, with constant dodging of clouds and possibly
changes in altitude. It also seems that this would be a personal limit, since
it's not defined by regulations. So, what are your own limits for how much
cloud cover you'll tolerate before filing IFR or simply not flying VFR?