Ah, that's frustrating. I was able to remove it that way, but I noticed that I still got the error that 'a newer version is already installed" when I tried to re-install. So, I conclude that there is somewhere that still has a file or setting with MySql...
In my case, I finally had to stop...