91.205(d)(2) is exactly the point. If a pilot is using VOR ground
facilities, a VOR receiver would be appropriate. If he's not (e.g.
using TACAN or GPS), a VOR receiver would not be appropriate and
therefore not required.

Support for the anti-requirement is in 91.205(e), which specifically
accounts for flying IFR without a VOR.