All of this wouldn't be an issue if I didn't want IntelliJ Idea as my IDE. IntelliJ prints an ugly warning that Open JDK isn't supported.
On Oracle's java website they don't provide a deb package for Ubuntu. I wasn't successful converting deb to rpm.
Turns out installing binary (bin) jdk on Ubuntu works like a charm and Intelli Idea is happy.
Now it is my turn to be a happy java developer again. :-)