Page is under construction.
Check the github issues for ways to contribute! Or provide your feedback in this quick form
Check the github issues for ways to contribute! Or provide your feedback in this quick form
Core Responsibilities
- Job intake from applications
- Capability matching across available orchestrators
- Routing and retry behavior under load or failure
- Service-level interfaces for developers and platforms
What Gateways Do Not Do
Gateways do not perform most GPU compute directly. Their primary function is coordination, service delivery, and reliability of the request path.Why Gateways Matter
Without gateways, every application would need to handle:- Compute provider discovery
- Dynamic routing and failover
- Capacity and availability management
- Integration-specific operational logic
Typical Flow
- App submits a workload request
- Gateway evaluates compatible orchestrators
- Gateway dispatches job to selected orchestrator
- Gateway returns result to the app