<p>Chennai: The Indian Institute of Technology Madras (IIT-M) and IITM Pravartak Technologies Foundation has partnered with a California-based startup to announce the launch of Kompact AI, a platform that enables foundational models to be built and served using CPUs without requiring GPUs, that are expensive and hard to obtain.</p><p>The Centre of AI Research (COAIR) established in partnership with Ziroh Labs has unveiled the first version of ‘Kompact AI’ , developed by scientists and engineers from India. </p>.IIT Madras to create 2 extra seats in UG courses for students excelling in national, intl olympiads.<p>The start-up has already optimised 17 AI models, including DeepSeek, Qwen and Llama, to run efficiently on CPUs and they have been benchmarked with IIT Madras, evaluating both quantitative performance and qualitative accuracy. </p><p>The platform is also aligned with India’s AI Mission, “AI for All” – from India for the world.</p><p>Kompact AI enables AI model development and deployment on CPUs, removing the need for costly GPUs and reducing the infrastructure burden and operates without constant internet connectivity, making it ideal for deployment in remote areas with limited or no access to reliable internet.</p><p>“This effort is certainly a major step in arresting the possible AI divide between one who can afford the modern hyper scalar systems and one who cannot,” IIT-M Director Prof V Kamakoti said. </p><p>Kompact AI, according to IIT-M, can play a transformative role as it leverages multiple optimisations algorithmically and implementation-wise to execute models on the low end without any support required for external communication, such as the Internet. </p><p>Dr Madhusudhanan B, Principal Consultant - IITM Pravartak Technologies Foundation said through the CoAIR, they will build specific, actionable AI models that can be deployed at scale, benefiting people in rural and underserved areas across India. </p><p>“This is about taking technology beyond the labs and putting it into the hands of those who need it the most,” he said. </p><p>This AI platform aims to democratise AI by allowing developers across the globe to build, train and infer AI using CPUs commonly found in Cloud Data Centers and Edge Devices. Kompact AI enables AI development without violating any data privacy and data residency regulations across the globe.</p><p>The IIT-M said Kompact AI enables models to be deployed over CPUs without sacrificing quality and at least 3x performance than the current state of the art, thereby providing GPU-like scale and speed and features a Model Library, which consists of multiple foundational models optimised for CPU compatibility.</p>
<p>Chennai: The Indian Institute of Technology Madras (IIT-M) and IITM Pravartak Technologies Foundation has partnered with a California-based startup to announce the launch of Kompact AI, a platform that enables foundational models to be built and served using CPUs without requiring GPUs, that are expensive and hard to obtain.</p><p>The Centre of AI Research (COAIR) established in partnership with Ziroh Labs has unveiled the first version of ‘Kompact AI’ , developed by scientists and engineers from India. </p>.IIT Madras to create 2 extra seats in UG courses for students excelling in national, intl olympiads.<p>The start-up has already optimised 17 AI models, including DeepSeek, Qwen and Llama, to run efficiently on CPUs and they have been benchmarked with IIT Madras, evaluating both quantitative performance and qualitative accuracy. </p><p>The platform is also aligned with India’s AI Mission, “AI for All” – from India for the world.</p><p>Kompact AI enables AI model development and deployment on CPUs, removing the need for costly GPUs and reducing the infrastructure burden and operates without constant internet connectivity, making it ideal for deployment in remote areas with limited or no access to reliable internet.</p><p>“This effort is certainly a major step in arresting the possible AI divide between one who can afford the modern hyper scalar systems and one who cannot,” IIT-M Director Prof V Kamakoti said. </p><p>Kompact AI, according to IIT-M, can play a transformative role as it leverages multiple optimisations algorithmically and implementation-wise to execute models on the low end without any support required for external communication, such as the Internet. </p><p>Dr Madhusudhanan B, Principal Consultant - IITM Pravartak Technologies Foundation said through the CoAIR, they will build specific, actionable AI models that can be deployed at scale, benefiting people in rural and underserved areas across India. </p><p>“This is about taking technology beyond the labs and putting it into the hands of those who need it the most,” he said. </p><p>This AI platform aims to democratise AI by allowing developers across the globe to build, train and infer AI using CPUs commonly found in Cloud Data Centers and Edge Devices. Kompact AI enables AI development without violating any data privacy and data residency regulations across the globe.</p><p>The IIT-M said Kompact AI enables models to be deployed over CPUs without sacrificing quality and at least 3x performance than the current state of the art, thereby providing GPU-like scale and speed and features a Model Library, which consists of multiple foundational models optimised for CPU compatibility.</p>