Awesome AI Agent Stack
Workflow Automation
No-code and code-first automation with AI steps — the glue between your agents and everything else.
AI workflow platforms
n8n templates & tooling
Durable workflow engines
Data pipeline orchestration
- dagster-io/dagster - Orchestration platform for data, ML, and long-running agent pipelines.
- flyteorg/flyte - Dynamic, resilient orchestration for data, models, and compute.
- PrefectHQ/prefect - Workflow orchestration for resilient data and agent pipelines.
- apache/hamilton - Define testable, modular dataflows and agent pipelines in Python.
- spotify/luigi - Python module for building complex pipelines of batch jobs.
- dbt-labs/dbt - Transform data in your warehouse with SQL-based DAG pipelines.
- apache/dolphinscheduler - Modern distributed data orchestration platform.
- kedro-org/kedro - Toolbox for production-ready, reproducible data science pipelines.
- mage-ai/mage-ai - Build, run, and manage data pipelines with a notebook UI.
- apache/nifi - Data integration platform with visual flow-based programming.
- biolab/orange3 - Visual programming for interactive data analysis and ML.
- nextflow-io/nextflow - DSL for data-driven computational pipelines.
- Netflix/maestro - Netflix's workflow orchestrator for data pipelines.
- SQLMesh/sqlmesh - Scalable data transformation with backwards-compatible pipelines.
- snakemake/snakemake - Workflow management system for reproducible data analysis.
- apache/hop - Visual data orchestration platform for pipelines.
- broadinstitute/cromwell - Scientific workflow engine for simple, scalable pipelines.
- aiidateam/aiida-core - Workflow engine for computational science and provenance.
- arvados/arvados - Platform for managing biomedical big-data pipelines.
- dagucloud/dagu - Self-hostable workflow orchestrator with a web UI and DAGs.
- apache/camel - Open-source integration framework with 350+ connectors.
Task queues & schedulers
BPM & process engines
CI/CD & event automation