Skip to main content
Back to Pulse
TechCrunch

Sources: Project SGLang spins out as RadixArk with $400M valuation as inference market explodes

Read the full articleSources: Project SGLang spins out as RadixArk with $400M valuation as inference market explodes on TechCrunch

What Happened

SGLang, which originated as an open source research project at Ion Stoica’s UC Berkeley lab, has raised capital from Accel.

Our Take

$400M for an inference optimization library is wild. SGLang's tech is legitimately clever—token scheduling, smart caching, dynamic batching.

But inference is commoditizing. OpenAI's got vLLM, there are fork fests everywhere, everyone's solving the same problems.

This valuation assumes a moat that doesn't exist yet. First-mover advantage in infrastructure doesn't last.

What To Do

Wait for third-party benchmarks showing 30%+ latency wins before integrating.

Cited By

React

Loading comments...