What is dstack?

dstack is an open-source container orchestration engine designed for AI workloads across any cloud or data center.

The supported cloud providers include AWS, GCP, Azure, Lambda, TensorDock, Vast.ai, CUDO, and RunPod. You can also use dstack ro run workloads on on-prem servers.

Think of dstack as a lightweight alternative to Kubernetes or Slurm that provides a straightforward interface for AI model development, training, and deployment.

dstack supports dev environements, running tasks on clusters, and deployment with auto-scaling and built-in authorization, all right out of the box.

dstack is vendor-agnostic, allowing you to utilize any open-source libraries, frameworks, or tools from your container.

Why use dstack?

1. Lightweight and easy-to-use compared to Kubernetes and Slurm
2. Supports all major GPU cloud providers
3. Scalable and reliable for production environments
4. Enables management of AI infrastructure across multiple clouds without vendor lock-in
5. Fully open-source

How does it work?

1. Install the open-source version of dstack and configure your own cloud accounts, or sign up with dstack Sky
2. Define configurations such as dev environments, tasks, and services.
3. Run configurations via dstack's CLI or API.
4. Use pools to manage instances and on-prem servers.

Where do I start?

1. Follow quickstart
2. Browse examples
3. Join the community via Discord