Well-Lit Paths

Well-lit paths are curated, end-to-end guides for llm-d's native inference patterns, intelligent routing algorithms, and runtime traffic regulation engines.

These guides are organized into three native architectural groupings:

Core Capability Building Blocks

Individual functional features, sophisticated routing algorithms, and physical inference execution paths.

Workloads

Cohesive, production-grade deployment guides that compose our capability building blocks into one horizontal stack tuned for a use case.

Traffic Control & Autoscaling

Native runtime request queuing, traffic surge gating, and dynamic inference pool replica capacity elasticity.