What is dstack?¶
dstack
is an open-source orchestration engine for running AI workloads. It supports a wide range of cloud providers (such as AWS, GCP, Azure,
Lambda, TensorDock, Vast.ai, CUDO, RunPod, etc.) as well as on-premises infrastructure.
Why use dstack?¶
- Designed for development, training, and deployment of gen AI models.
- Efficiently utilizes compute across cloud providers and on-prem servers.
- Compatible with any training, fine-tuning, and serving frameworks, as well as other third-party tools.
- 100% open-source.
How does it work?¶
- Install the open-source version of
dstack
and configure your own cloud accounts, or sign up with dstack Sky - Define configurations such as dev environments, tasks, and services.
- Run configurations via
dstack
's CLI or API. - Use pools to manage instances and on-prem servers.
Where do I start?¶
- Follow quickstart
- Browse examples
- Join the community via Discord