Why are there so many atheists in Kerala?

I recently started a new job in Mumbai, and one of the first questions my colleague asked me was, "Why are there so many non-believers in Kerala?" They seemed to think that a large number of people in Kerala are atheists or agnostics.

This question left me curious. Why does we have this reputation? Is it because of the state's history, its culture, or something else?