Chennai: AI large language models have largely become commoditised, and the value now lies in companies building systems that combine AI with structured enterprise data, privacy safeguards and regulatory guardrails, said Sridhar Vembu, chief scientist and co-founder of Zoho.Speaking to TOI at Zoholics, the company’s annual conference on Wednesday, he said AI inferencing is expected to move to local hardware. He was speaking after Zoho introduced an AI chatbot across its products and announced its foray into vertical software applications.He acknowledged that the spike in server and data centre costs, along with AI spending, has impacted profitability, adding that Zoho is taking several steps to reduce compute costs, including making its code more efficient and exploring running AI models on laptops for low-stakes tasks. Local AI, or local inference, refers to hosting AI models on one’s own devices instead of using data centres.“AI Adoption is moving towards lower-cost AI, and I believe later towards local AI. But this will take six months to one year. You can expect a lot more advances on this front. The smaller models are growing up to become more intelligent. Larger models are becoming more efficient to run on local hardware. You can predict the trend. That’s why I think AI will become a commodity,” he said.He said rising memory prices and AI inference costs have hit profitability. “The server cost 4 times more compared to a year ago, the cost of memory is up 5 times and AI token spend is skyrocketing. We are trying to make both efficient. If you are successful then we can keep a lid on prices, but we have chosen not to raise prices,” he said.Vembu also explained the rationale behind Zoho’s move into industry-focused vertical software applications. He said combining horizontal breadth with vertical SaaS brings in specific business rules, regulatory mandates and end-to-end visibility of a workflow, which would make AI integration more useful and help them gain customers. He dismissed concerns that AI agents would lead to a reduction in seat-based subscriptions, adding that Zoho is witnessing growth in its number of customers.On the company’s chatbot, he said, “LLM brings distilled knowledge of everything in the world. Behind the Zoho suite sits all of the business information, what we call the data models. We are bringing the two together and building critical security and governance guardrails, safeguards that are necessary to protect companies’ proprietary data and be compliant with regulations.”
