Reproducible ML workflows for teams

Welcome to dstack

dstack helps teams run ML workflow in a configured cloud, manage dependencies, and version data.

Features

• Workflows as code: Define your ML workflows as code, and run them in a configured cloud via the command-line.
• Reusable artifacts: Save data, models, and environment as workflows artifacts, and reuse them across projects.
• Built-in containers: Workflow containers are pre-built with Conda, Python, etc. No Docker is needed.

NOTE:

You can use the dstack CLI from both your IDE and your CI/CD pipelines.

For debugging purposes, you can run workflow locally, or attach to them interactive dev environments (e.g. VS Code, and JupyterLab).

How does it work?

1. Install dstack CLI locally
2. Configure the cloud credentials locally (e.g. via ~/.aws/credentials)
3. Define ML workflows in .dstack/workflows.yaml (within your existing Git repository)
4. Run ML workflows via the dstack run CLI command
5. Use other dstack CLI commands to manage runs, artifacts, etc.

When you run a workflow via the dstack CLI, it provisions the required compute resources (in a configured cloud account), sets up environment (such as Python, Conda, CUDA, etc), fetches your code, downloads deps, saves artifacts, and tears down compute resources.

Demo

Get started in 30 min

Set your first ML workflows up and running should take 30 min or less.

• 1. Explore examples Browse the featured examples of what you can do with dstack.
• 2. Install the CLI Install and configure the dstack CLI in no time.
• 3. Follow quickstart Try dstack yourself by following a simple step-by-step tutorial.
• 4. Join our community Join our Slack chat to get support and hear about announcements.

Subscribe to the newsletter to get notified about new updates.