Yes, I agree, the remaining IFR flights are likely to be safer.

I'm not sure I even agree with that. IFR flying is a perishable skill,
and the limitations imposed will certainly cause one to make fewer
flights. Unless these are replaced with practice/training flights (and
very few people have that kind of discipline) the resulting reduction
in proficiency may well offset the reduction in exposure.

The loss of utility, however, is quite certain.

Michael