I wouldn't get that power supply, not because of the name, but because it's modular. Modular power supplies have an unfavorable flaw. Due to the plugs, it becomes interrupted current, which builds up resistance. Resistance can cause fluctuations in voltage, something you do not want in your PC. This will cause random restarts or BSODs.
Get an uninterrupted power supply. The others were right on my recommending, Antec, Forton, Seasonic, OCZ.
I agree with the video card also, go 6600GT. Best bang for the buck for non-gamer / may-be on day you'll find a game you like and want to play it.
For a floppy drive, consider looking into a Mitsumi 7 in 1 Floppy / Media Card reader. Since floppies aren't used that much, at least you'll have the Media Card reader as well.