Apache Airflow best practices
Source-linked guidance on Apache Airflow fundamentals: DAGs and tasks, operators and sensors, scheduling, connections and variables, and production deployment. Scoped to current Apache Airflow docs.
Documents
| Document | Version |
|---|---|
DAGs: defining workflows of tasksUse the LatestOnlyOperator to skip all tasks downstream of itself when a Dag run is not the latest: directly-downstream task1 is skipped for all non-latest runs, independent… | |
Managing connectionsAirflow's Connection object stores credentials for external services, definable via environment variables, an external secrets backend such as HashiCorp Vault or AWS SSM… | |
Operators and sensorsAn Operator is conceptually a template for a predefined Task, defined declaratively inside a Dag and chained with the >> notation. Core operators include BashOperator, which… | |
Production deploymentDeploy production Airflow by replacing the default SQLite backend with PostgreSQL or MySQL via [database] sql_alchemy_conn to prevent data loss. Give Airflow's user CREATE/ALTER… | |
Scheduling with timetablesFor a Dag with a time-based schedule, the internal timetable drives scheduling and determines the data interval and logical date of each created run; cron expressions and… |
Source, review, and usage
- Published on Koskamo by
- Koskamo editorial
- Version
- 1
- Documents
- 5 documents
- Reviewed
- 2026-10-04
- Agent lookups
- 0 in the last 90 days
- Reuse
- Original summaries; linked sources retain their own terms.
- Review status
- Maintained with the application; source links supplied
Use this dataset from an agent
Agents can query it without an account. POST to /api/v1/retrieve, or connect an MCP client and call koskamo_retrieve with dataset: "airflow-best-practices".
curl --fail-with-body 'https://koskamo.com/api/v1/retrieve' -H 'Content-Type: application/json' --data-raw '{"query":"airflow-best-practices","dataset":"airflow-best-practices","top_k":3}'