Intel Corporation announced a collaboration with RadixArk to optimize SGLang, an open-source AI inference stack, for Intel platforms that aims to help developers and enterprises deploy leading AI models and build AI applications more efficiently and cost-effectively.
“Enterprise AI is moving beyond isolated performance benchmarks to solving full-system production deployments,” said Anil Nanduri, vice president, AI Products & GTM, Intel Data Center Group. “This collaboration ensures developers have Day-0 readiness and high-performance inference software directly optimized for Intel CPUs, GPUs and accelerators with an open approach and gives them the freedom to choose the tools, frameworks and technologies that best fit their needs.”
Enterprises require heterogeneous, open inference infrastructure, as AI models grow larger and more complex. To deliver AI in production, it requires that every prompt is routed to the right place, matching the different workloads with the right intelligence, right compute and right economics. Open inference runtimes provide the essential connective tissue that makes full-stack deployments practical, reliable, and economically sustainable across diverse enterprise environments.
This collaboration expands developer choice to deploy leading AI models on enterprise-proven Intel hardware. Model builders and software engineers can build and innovate on standard, open frameworks and interfaces while taking full advantage of Intel’s compute density and built-in hardware acceleration features, including Intel Advanced Matrix Extensions (Intel AMX). Developers gain faster time-to-production, reduced latency, and flexible deployment options across existing data center and cloud capacity.
"Our collaboration with Intel is a major milestone for open-source AI inference, enabling SGLang optimization directly to Intel’s platforms,” said Ying Sheng, CEO, RadixArk. “By upstreaming deep optimizations into the core framework, we are eliminating constraints and ensuring developers never have to compromise between open standards and high performance. Our mission to make frontier AI infrastructure open and accessible to every builder, and Intel’s enterprise-ready architecture gives development teams the flexibility and compute density they need to scale production AI workloads seamlessly."
