Dagster | Support by cloudimg

This is a repackaged open source software product wherein additional charges apply for cloudimg support services.

Overview Dagster is a fast, open source data orchestration platform for the development, production and observation of data assets. You define assets and jobs in plain Python and Dagster gives you a rich web interface to materialize them, schedule them, watch them run and inspect their lineage, with full visibility into every run. This image delivers Dagster fully installed in a dedicated virtual environment and run as system services, so a working orchestration platform is serving within minutes of launch.

Application Stack Dagster installed into a dedicated Python virtual environment under /opt/dagster and run by an unprivileged service account. The Dagster instance directory, holding the instance configuration and the run, event and schedule storage, stored on a dedicated data disk so it is independently resizable. Two systemd services: the webserver that serves the UI and the GraphQL API, and the daemon that drives schedules, sensors and the run queue. An nginx reverse proxy that publishes the UI on port 80 behind HTTP Basic authentication, with the WebSocket upgrade the UI needs to render fully.

Ready To Run Demo Project A demo Dagster project ships at /opt/dagster/demo: a handful of software-defined assets and a job, with a workspace file the webserver loads on start. It shows what a Dagster project looks like out of the box and gives you a working example to learn from. Point the workspace at your own code location and restart the services to go live.

Secure First Boot On the first boot of your instance a one shot service generates a fresh admin password, unique to that instance, writes it into the nginx credentials file and writes the password to a root only file. The Dagster webserver itself binds to loopback only and is never exposed without authentication. No shared or default credentials ship in the image.

Full WebSocket Support The Dagster UI streams live run and event updates over a GraphQL websocket. The bundled nginx proxy forwards the WebSocket upgrade and connection headers, so the UI loads and updates live behind authentication instead of hanging on a loading screen. The webserver info endpoint is reachable for monitoring.

cloudimg Support 24/7 technical support by email and chat. Help with deployment, defining assets and jobs, code locations and workspaces, scheduling and sensors, swapping the SQLite instance storage for PostgreSQL, TLS and performance tuning.

Use Cases Data pipeline and ELT orchestration. Software-defined asset management and lineage. Scheduled and event-driven data jobs. A self hosted control plane for analytics and machine learning workflows. A single-node Dagster deployment for development, demos and small teams.

All product and company names are trademarks or registered trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.