Had a closer look into the Haynes Manual and a couple of posts on the gixerjunkies website, and found out the engine needs to come to change it. But not only does the engine need to come out, but sump needs to be removed, clutch off and the engine split in two.
So engine came out friday night (after work)
Engine was split, seal changed and engine back in saturday night, finished about 1:30am Sunday morning.
And today I managed to get everything back, plugged in and re-filled the coolant and oil.
Bike seems to fine now with no leaks, haven't had the test ride yet, so the test run will be the ride to work.
This explains why I haven't been on site for a few days.
P.s. Big thanks to chris for helping out, it was certainly a struggle doing 95% of the work in my shed