Clarifai Launches First Vendor-Agnostic Compute Orchestration Capabilities to Optimize AI Performance and Spend

Customers can better orchestrate AI workloads, avoid vendor lock-in, and efficiently utilize compute spend

WASHINGTON, December 3, 2024 /PRNewswire/ — Clarifaïglobal AI leader and pioneer of the full-stack AI platform, today unveiled the public preview of the first compute orchestration capabilities for AI workloads on any model. AI, on any calculation, at any scale.

With Clarifai’s new IT orchestration capabilities, customers can maximize their IT investments, better leverage their cloud engagements and hardware for AI, and seamlessly use Clarifai SaaS compute, while managing and monitoring centralized management of costs, performance and governance. Clarifai is the only platform capable of building and orchestrating AI workloads across any hardware vendor, cloud provider, on-premises, or isolated environment, helping businesses eliminate dependency on -towards a supplier.

“Clarifai has always been ahead of the curve, with over a decade of experience meeting the critical needs of large enterprises and governments with the full stack of AI tools to build enterprise-class workloads. Personalized AI. We are now opening up the capabilities we have developed internally to optimize our compute costs as we scale to serve millions of models simultaneously. Our customers can now have the same cutting-edge tools to scale their AI workloads on their compute, no matter where they are,” said Matt ZeilerPh.D., founder and CEO of Clarifai. “As generative AI grows, our platform enables customers to reduce complexity and seamlessly build and deploy AI in minutes, at lower cost, with room to scale and flexibility to meet easily meet future business needs.

As one of the fastest production-grade deep learning platforms that developers, data scientists, and MLOps/ML engineers can rely on, Clarifai’s IT orchestration layer provides unique benefits , in particular the possibility of:

• Use computation cost-effectively and eliminate complexity. With an easy-to-use control plane, customers can efficiently manage access to AI resources, monitor performance and manage costs while Clarifai’s expertly designed platform manages dependencies and optimizations. The platform can automatically optimize resource usage through model grouping, simple dependency management, and customizable autoscaling options, including scaling down to zero for model replicas and compute nodes. These optimizations have been shown to reduce compute usage by 3.7x through model packaging and support over 1.6 million inputs per second with 99.9997% reliability. Depending on the configuration, this can result in a cost reduction of at least 60% and up to 90%.
• Deploy on any hardware or environment. Customers can deploy any model using any hardware vendor in any cloud, on-premises, isolated, or SaaS environment for inference purposes. Most competitors focus on inference in managed cloud or customer virtual private cloud (VPC) deployments. Few offer on-site offerings, and none offer isolated environmental support with proven success in meeting standards for the most demanding military deployments.
• Integrate a full stack of cutting-edge AI tools. Clarifai offers a comprehensive platform for the entire AI lifecycle: data labeling, training, assessment, workflow and feedback, on which any team can collaborate easily. This allows teams to customize AI workloads based on their business needs in minutes and seamlessly integrate with compute orchestration to dynamically route these workloads to optimal compute.
• Maintain business security and flexibility. Clarifai can deploy the compute plane in a customer’s cloud VPC or on-premises Kubernetes cluster without opening ports in the customer environment, configuring VPC peering, or creating identity and security management roles. personalized access (IAM) in their cloud or data centers. Administrators can also assign access to AI resources across teams and projects. This allows users to efficiently manage, monitor and utilize multiple compute planes from a single control plane without sacrificing security.

Clarifai’s team of researchers engaged deeply with customers to understand their challenges in optimizing AI performance and spend. Customers highlighted the need for tools that enable cost-effective scaling, transparent provisioning, and flexibility.

“This is the only way to ultimately scale, because you make choices easier for practitioners rather than forcing them to go back to AI engineering every time, or even worse, trying to perfect them on cloud computing,” noted one customer. .

Others highlighted the importance of optionality across environments: “If we had a way to think about it holistically and look at our on-premises costs versus our cloud costs, and then be able to orchestrate between environments on a cost basis would be incredibly valuable,” said another.

Clarifai’s innovation in IT orchestration extends Clarifai’s focus and leadership position beyond computer vision. With over 2 billion operations powering AI for vision, language and audio, Clarifai has consistently maintained over 99.99% uptime and 24/7 uptime, providing reliability and flexibility needed for critical applications.

Learn more here or consult the documentation here.

About Clarifaï

Clarifai is a global AI leader and pioneer of the full-stack AI platform that helps organizations, teams and developers build, deploy and operationalize AI at scale. Clarifai’s cutting-edge AI platform supports today’s modern AI technologies such as Large Language Models (LLM), Large Vision Models (LVM), Retrieval Augmented Generation (RAG) , automated data labeling, high-volume production inference, and much more. Founded in 2013, Clarifai is available in cloud, on-premises, or hybrid environments and has been used to create more than 1.5 million AI models with more than 400,000 users in 170 countries. Learn more about www.clarifai.com.

For more information or media inquiries, contact: (email protected).