ByteScale raises $95M to build a 'model hosting' native CDN for enterprises

Tech · 5 min read

ByteScale closed $95 million in Series B funding led by North Ridge Capital to accelerate development of a model-hosting CDN for enterprises. The company's service distributes model shards and inference endpoints across edge nodes to minimize latency for geographically dispersed users.

ByteScale's architecture focuses on versioning guarantees, model routing, and legal/data residency controls that enterprises need. The platform integrates with MLOps pipelines and supports on-prem connectors for regulated workloads.

The new funds will be used to expand edge points of presence, offer certified hardware acceleration options, and build deeper integrations with enterprise security stacks. ByteScale also announced partnerships with several telecoms to colocate model nodes nearer to end users.

Investors said the market is shifting from raw GPU allocation to delivery guarantees and predictable latency for mission-critical AI features, making ByteScale's CDN approach attractive to banks, telcos, and large SaaS vendors.