being an atheist means you believe that gods do not exist. Saying the bible doesn't necessarily mean that you dont believe in god, just not the story of the bible.
Although i dont know rather or not you have to believe in the bible to be a "true" Christian\Catholic