If you want a really easy package – as the name indicates – try EasyPHP – http://www.easyphp.org/. I tried some other alternatives, but this one beats them all.
After downloading and installing the main package (PHP + Apache + MySQL + PhmMyAdmin), you can download and install modules like WordPress, Drupall, Joomla! … and install them in minutes.
Once installed and started it was a breeze to start PhpMyAdmin or WordPress (click “front office”), …
I could write a lot more (and add more screenshots), but just give it a try if you want to do some local website testing: really recommended !