You're right that ethnicity has nothing to do with this question.

Perhaps a Jewish Atheist is someone who goes through the religious rituals without any belief behind them. I certainly know people who are culturally Jewish but do not believe in G-d.