The fact that it is AGP and vanilla will probably account for the discrepancy between the expected and actual score. The people who get 4000 probably have a 6800gt pci-e.
I have a 6800 vanilla AGP and even at stock speeds my score was about 3500 in '05. Maybe it's just a defective card. Could you return it and get another one? Maybe not by XFX?