Unless your connection to the internet is also at 54Mbps, you have nothing to worry about.
If you have cable internet, you probably get up to 3Mbps. As long as your wireless card is getting higher than 3Mpbs, you shouldn't notice any difference in your internet performance. You'll only see a drop in speed if you're transfering large files between computers on a network.