Hugging Face HUGS accelerates the development of AI apps based on open models – Neowin
Over the past year or so, open-source AI models have significantly caught up in performance to the popular closed-source models from OpenAI, Google, and others. Yet, developers haven’t widely adopted them due to the overhead associated with deploying and maintaining these models on different hardware. To solve this problem, Hugging Face today announced Hugging Face Generative AI Services (HUGS), an optimized, zero-configuration inference microservice for developers to accelerate the development of AI apps based on open models.
HUGS model deployments also provide an OpenAI-compatible API for a drop-in replacement of existing apps built on top of model provider APIs. This will help developers easily migrate from OpenAI model-based apps to open-source model-based apps.
HUGS is built on open-source technologies such as Text Generation Inference and Transformers. It is optimized to run open models on various hardware accelerators, including NVIDIA GPUs, AMD GPUs, AWS Inferentia (coming soon), and Google TPUs (coming soon). Thirteen popular open LLMs, including Meta’s LLaMa, are supported today, and more LLMs will be supported in the future. HUGS can be deployed on Amazon Web Services, Google Cloud Platform, and Microsoft Azure (coming soon). HUGS offers on-demand pricing based on the uptime of each container on public clouds.
According to Hugging Face, HUGS offers the following advantages:
You can learn more about HUGS here. With its focus on open-source and ease of use, HUGS has the potential to democratize access to powerful AI models and accelerate the development of innovative AI applications.
with 1 comment
with 0 comment s
with 3 comment s
with 6 comment s
Login or Sign Up to read and post a comment.
Please enter your reason for reporting this comment.
windows insider
manba one
windows server
silent hill 2
windows 11 insider preview promo
dockcase
windows 11 insider preview promo
terramaster f8 ssd plus
windows 11 insider preview promo
frostpunk 2
windows 11 24h2
windows 11 24h2 unsupported
hard drive
© Since 2000 Neowin® All trademarks mentioned are the property of their respective owners.
source
This article was autogenerated from a news feed from CDO TIMES selected high quality news and research sources. There was no editorial review conducted beyond that by CDO TIMES staff. Need help with any of the topics in our articles? Schedule your free CDO TIMES Tech Navigator call today to stay ahead of the curve and gain insider advantages to propel your business!
