edding offers two different products for non-permanent writing on glass:

The edding 90 glassboard marker works exceptionally well for writing on glass indoors and is easy to dry-wipe, leaving the surface completely clean. With this marker, there’s no need for wet erasing. For smudge-proof use on, say, window panes and chalkboards, we recommend the edding 4090 and 4095 chalk markers. Their ink is highly durable and is really easy to wipe off with a damp cloth.