That tape would do fine. It's not like the plexiglass is heavy enough to fall off. Plus it would be easier to take off the Window, if you wanted to do any changes, for any reason.
...lol...I use masking tape, to hold a glass panel, to the side panel.