Are there at least some restrictions on when this can be used? I'm hoping
that it can only be done in good VFR conditions when the tower can see
both aircraft?

No restrictions but common sense come in to play there.