I used to be that ambitious. Now I know them and learning VB6! Ok, so my C++ is a little rusty.
Anyway, I basically learnt them through loads of online tutorials and doing it myself. I experimented with the code. It's now two years since I started just with HTML. It's taken me this long to realise that it might have been easier working from the hardest (C++) to VB6, then PHP and so on. It's also taken me this long to realise this isn't the industry for me.
It will take you years to master all of them. Especially C++ and PHP. More so C++, at least 5 years of regular use.
I've not mastered PHP/C++ but I do have the founding knowledge and good understanding of the main stuff and how to make programs. The rest for me is just a case of referrencing and research.
A great start for PHP is
Zend. I only really learnt the main stay of PHP from there. I couldn't grasp it any where else.
As for C++, a mate of mine run me through that one as well as online tutorials.
HTML is covered well at W3Schools, as Republikin said. I would suggest going for XHTML though (stricter).
I think CSS is one of those things where you just need to do it to understand it. I learnt by looking at the main constructs and rules (how to use one, apply it to the HTML, selectors, properties, ids and classes) and then by messing around with it.
MySQL is not really that much. It's got amazing support in PHP, so the Zend tutorial covers mostly what you need at the moment.
All in all, I would say it's going to be longer, much longer, to 'master' these than you might have first thought.
I personally haven't used any books. Other than for VB6 which I am learning at College. The book doesn't do much for me though as I play around in the code so much that I run into new functions, array types, loops and generally how to do things basically.
If you go to your local bookstore, like in the UK we have Waterstones or WHSmith (I suggest Waterstones though), you'll be able to find plenty of books on the different languages you're looking for. The ones I have flicked through include the Dummies series (I wasn't too keen though) and the white/red split front-cover with grayscale animal on (can't remember name sorry) which looked quite useful.
