• Repository

Meta

• License: Apache Software License (Apache License)
• Author: Fernando Celmer
• Tags pipeline , workflow , etl , task-runner , orchestration , automation , parallel , async , retry , data-pipeline , scheduler , cron , cron-job
• Requires: Python >=3.9
• Provides-Extra: aws , deploy-alibaba , deploy-aws , deploy-gcp , deploy-github , gcp , otel , scheduler , sentry

Classifiers

• Development Status
  • 4 - Beta
• Intended Audience
  • Developers
• License
  • OSI Approved :: Apache Software License
• Natural Language
  • English
• Operating System
  • OS Independent
• Programming Language
  • Python :: 3.9
  • Python :: 3.10
  • Python :: 3.11
  • Python :: 3.12
  • Python :: 3.13
• Topic
  • Software Development :: Libraries
  • Software Development :: Libraries :: Python Modules
  • System :: Distributed Computing

---

Dotflow

Dotflow is a lightweight Python library for execution pipelines. Define tasks with decorators, chain them together, and deploy to any cloud — with built-in retry, parallel execution, storage, observability, and cloud deployment.

Why Dotflow?

• Simple — @action decorator + workflow.start(). That's it.
• Resilient — Retry, backoff, timeout, checkpoints, and error handling out of the box.
• Observable — OpenTelemetry traces, metrics, and logs. Sentry error tracking.
• Deployable — dotflow deploy --platform lambda ships your pipeline to AWS in one command.
• Portable — Same code runs on Lambda, ECS, Cloud Run, Alibaba FC, Kubernetes, Docker, or GitHub Actions.

Install

pipinstalldotflow

Quick Start

fromdotflowimport DotFlow, action

@action
defextract():
 return {"users": 150}

@action
deftransform(previous_context):
 total = previous_context.storage["users"]
 return {"users": total, "active": int(total * 0.8)}

@action
defload(previous_context):
 print(f"Loaded {previous_context.storage['active']} active users")

workflow = DotFlow()
workflow.task.add(step=extract)
workflow.task.add(step=transform)
workflow.task.add(step=load)

workflow.start()

Deploy anywhere

Write your pipeline once. Deploy to any cloud with a single command.

dotflowinit
dotflowdeploy--platformlambda--projectmy_pipeline

Supported platforms

Platform	Deploy method
👁 Image Docker	docker compose up
👁 Image AWS Lambda	dotflow deploy
👁 Image 👁 Image AWS Lambda + EventBridge	dotflow deploy --schedule
👁 Image 👁 Image AWS Lambda + S3 Trigger	dotflow deploy
👁 Image 👁 Image AWS Lambda + SQS Trigger	dotflow deploy
👁 Image 👁 Image AWS Lambda + API Gateway	dotflow deploy
👁 Image AWS ECS Fargate	dotflow deploy
👁 Image 👁 Image AWS ECS + EventBridge	dotflow deploy --schedule
👁 Image Google Cloud Run	dotflow deploy
👁 Image 👁 Image Cloud Run + Scheduler	dotflow deploy --schedule
👁 Image Kubernetes	kubectl apply
👁 Image Alibaba Cloud FC	dotflow deploy
👁 Image Alibaba Cloud FC + Timer	dotflow deploy --schedule
👁 Image GitHub Actions	dotflow deploy

See all 34+ platforms →

Optional extras

pipinstalldotflow[aws]# S3 storage
pipinstalldotflow[gcp]# Google Cloud Storage
pipinstalldotflow[scheduler]# Cron scheduler
pipinstalldotflow[otel]# OpenTelemetry
pipinstalldotflow[sentry]# Sentry error tracking
pipinstalldotflow[deploy-aws]# AWS deploy (Lambda, ECS)
pipinstalldotflow[deploy-gcp]# GCP deploy (Cloud Run)
pipinstalldotflow[deploy-alibaba]# Alibaba Cloud deploy (FC)
pipinstalldotflow[deploy-github]# GitHub Actions deploy

Read the full documentation →

Documentation

Section	Description
Concepts	Workflows, tasks, context, providers, process modes
How-to Guides	Step-by-step tutorials for workflows, tasks, and CLI
Cloud Deployment	Deploy to AWS, GCP, Alibaba, Kubernetes, Docker, GitHub Actions
Integrations	OpenTelemetry, Sentry, Telegram, Discord, S3, GCS, Server
Examples	Real-world pipelines: ETL, health checks, async, scheduler
Reference	API reference for all classes and providers
Custom Providers	Build your own storage, notify, log, tracer, or metrics provider

Features

More Examples

All examples are available in the docs_src/ directory.

Commit Style

Icon	Type	Description
⚙️	FEATURE	New feature
📝	PEP8	Formatting fixes following PEP8
📌	ISSUE	Reference to issue
🪲	BUG	Bug fix
📘	DOCS	Documentation changes
📦	PyPI	PyPI releases
❤️️	TEST	Automated tests
⬆️	CI/CD	Changes in continuous integration/delivery
⚠️	SECURITY	Security improvements

License

👁 GitHub License

This project is licensed under the terms of the Apache License 2.0.

Verified details

These details have been verified by PyPI

Project links

• Changelog
• Documentation
• Homepage
• Issues
• Repository

GitHub Statistics

Maintainers

👁 Avatar for fernandocelmer from gravatar.com
fernandocelmer

Unverified details

These details have not been verified by PyPI

• Download URL: dotflow-1.0.0.tar.gz
• Upload date: May 2, 2026
• Size: 70.7 kB
• Tags: Source
• Uploaded using Trusted Publishing? Yes
• Uploaded via: twine/6.1.0 CPython/3.13.12

Hashes for dotflow-1.0.0.tar.gz

Algorithm	Hash digest
SHA256	2f7a6c02cbcd990da3321099a79b3c0746612567453bd6c030b25a4e7cc917f1
MD5	a929da428465a3f2a444d4e221e46d2a
BLAKE2b-256	bf108e329bc7aa60e674eaa815812fcd93f9e42312495522f1f0978eebee67d8

See more details on using hashes here.

• Download URL: dotflow-1.0.0-py3-none-any.whl
• Upload date: May 2, 2026
• Size: 108.3 kB
• Tags: Python 3
• Uploaded using Trusted Publishing? Yes
• Uploaded via: twine/6.1.0 CPython/3.13.12

Hashes for dotflow-1.0.0-py3-none-any.whl

Algorithm	Hash digest
SHA256	c7c874ae817a6c22d7fc28d47ee9f54ba20fc9196ef287d767e20df389515e84
MD5	41eeee44d2739a660b3d993f74da2da9
BLAKE2b-256	e92fe0c999e2046bbac06c58c07aef3d160d03daf0ac31108706c2fe343c085c

See more details on using hashes here.