"Only" 88 psf (BTW, that sounds suspiciously low) versus the Phantom's 76.
There's a lot more too it than wing loading. The F-104 had superior
specific excess power than the Phantom at one G, inferior at five,
significantly inferior at seven. The F-4 was not noted as an agile machine,
but it was superior to the 104 (and that's based on perhaps limited but
nevertheless real world personal experience).

Based on your method of comparison, many highly maneuverable aircraft would
appear to be less capable than they are.

R / John