What is dstack?¶
dstack
is an open-source container orchestration engine designed for running AI workloads across any cloud or data center.
The supported cloud providers include AWS, GCP, Azure, Lambda, TensorDock, Vast.ai, CUDO, and RunPod. You can also use
dstack
ro run workloads on on-prem servers.
Think of dstack
as a lightweight alternative to Kubernetes or Slurm that provides a
straightforward interface for AI model development, training, and deployment.
dstack
supports dev environements, running tasks on clusters, and deployment with auto-scaling and built-in
authorization, all right out of the box.
dstack
is vendor-agnostic, allowing you to utilize any open-source libraries, frameworks, or tools
from your container.
Why use dstack?¶
- Lightweight and easy-to-use compared to Kubernetes and Slurm
- Supports all major GPU cloud providers
- Scalable and reliable for production environments
- Enables management of AI infrastructure across multiple clouds without vendor lock-in
- Fully open-source
How does it work?¶
- Install the open-source version of
dstack
and configure your own cloud accounts, or sign up with dstack Sky - Define configurations such as dev environments, tasks, and services.
- Run configurations via
dstack
's CLI or API. - Use pools to manage instances and on-prem servers.
Where do I start?¶
- Follow quickstart
- Browse examples
- Join the community via Discord