While I will admit that floppy drives aren't really useful anymore, I still think that they were by far the best removable storage solution devised for the computer. Sure, CDs and DVDs are great for their size, but I find writing and erasing them to be such a hassle. The floppy drive was simply a drag and drop system, nothing complicated, and it was relatively fast.
Sure, you can compare memory cards to them now, but I still find them rather ridiculously overpriced, and card readers still aren't that common.
And just a quick little tidbit, the floppy drive is the longest lasting popular interface in computer history, although I figure the CD will pass it once the floppy no longer becomes necessary...