Use Mineral spirits. Make up a little tray out of an old picture frame
fill with mineral spirits. Place plexi in there and cover with another
piece of polyethethelene to reduce evaporation. Should soften enough to
peel the paper off.
If that doesn't work blast it with a pressure washer