IBM expands small AI model family – CIO Dive

Let CIO Dive’s free newsletter keep you informed, straight from your inbox.

The technology vendor said Granite 3.2 Instruct can complete complex reasoning tasks, mathematical problems and general language requests.
Large language models might have dominated the enterprise generative AI conversation initially, but business leaders are turning to lightweight versions as they look to rein in costs and boost efficiency.
Smaller models typically use less computing power and are often tailored to complete specific tasks. Enterprises have struggled in both areas with LLMs resulting in delayed projects due to computing availability and prioritization of domain-specific capabilities in AI purchases. 
Vendor options are plentiful, from Google’s lightweight Gemma models to Microsoft’s Phi family and OpenAI’s o3-mini.
“We have been very vocal for about a year that smaller models and more reasonable training times are going to be essential for enterprise deployment of large language models,” IBM CEO Arvind Krishna said during IBM’s Q4 2024 earnings call in January. “We see as much as 30 times reduction in inference costs using these approaches.”
The company attributed around $1.5 billion in new bookings during the latest quarter to its generative AI business. Retail and commercial banking company NatWest and defense manufacturer Lockheed Martin are among the enterprise clients already utilizing IBM’s Granite models, according to Krishna. 
All Granite 3.2 models are available under the Apache 2.0 license on Hugging Face. Customers can also access select models on IBM watsonx.ai, LM Studio, Ollama and Replicate. 
“The release of Granite 3.2 marks only the beginning of IBM’s explorations into reasoning capabilities for enterprise models,” IBM said in a release.
Get the free daily newsletter read by industry experts
IT occupations across the economy contracted by 14,000 last month, a CompTIA review of U.S. Bureau of Labor Statistics data found.
The act took effect Thursday, but enforcement deadlines are spread out through 2027. The act could have a similar global influence to GDPR.
Subscribe to CIO Dive for top news, trends & analysis
Get the free daily newsletter read by industry experts
IT occupations across the economy contracted by 14,000 last month, a CompTIA review of U.S. Bureau of Labor Statistics data found.
The act took effect Thursday, but enforcement deadlines are spread out through 2027. The act could have a similar global influence to GDPR.
The free newsletter covering the top industry headlines

source
This is a newsfeed from leading technology publications. No additional editorial review has been performed before posting.