I managed to find a new brake pad at Bikeplace.se, the first store I checked and the one closest to work. So I started working on the bike as soon as I got home and managed to pull out the old pad. Indeed...one side was completely worn down.

I opened the oil lid and tried to push back the piston and it went about half way so that I couldn't get the disc between the pads. So the quick fix was to put one new pad and the one that wasn't worn down together and things fit back without adjustment. I know that this is a quick fix but it will do.

Besides, I want to order some SwissStop pads since these work superb for cross.