Mourning her demise, Rahman, posted a photo of her on his official Twitter account on Monday afternoon.
Commenting on his tweet, politicians and celebrities from the world of music and cinema expressed condolences.
Tamil Nadu Chief Minister K Palaniswami tweeted: "Sad to know that Kareema Begum, mother of music great AR Rahman died of illness."
Following suit, DMK President M K Stalin also extended his condolences. "He said she played a "big role" in Rahman's musical journey from Tamil cinema to across the globe," he tweeted.
Cricket legend Sachin Tendulkar also shared: "Deepest condolences on your mother's demise, @arrahman."The loss of a parent is one of the most testing phases of one's life. My sincere prayers and sympathies are with you and your family."
Composer-singer Salim Merchant said, "Very sorry for your loss AR. We pray that Amma gets Jannat-Ul-firdaus."
Rahman's frequent collaborator, singer Shreya Ghoshal said Begum was one of the most affectionate people she came across. "Deeply saddened by this news Rahman sir. She was one of the most gentle affectionate person I have met. Praying for her departed soul."
Filmmaker Shekhar Kapur tweeted: "Your heart is broken, I know. But your mother left you with an inner strength , an inner resilience and belief .. that I have seen and admired for long. Stay strong, my friend."
Music composers Thaman, Devi Sri Prasad and many others also paid tributes to Begum.
Kareema Begum was the wife of noted Malayalam music composer Rajagopala Kulashekharan aka RK Shekhar, who passed away in 1976.
She is survived by her son Rahman and daughters AR Reihana, Ishrath Qadri and Fathima Shekhar.