unsubbed.co

Kestra

Event-driven orchestration platform for building, scheduling, and monitoring data pipelines and workflows in code.

Overview

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications Use declarative language to build simpler, faster, scalable and flexible workflows The project has 27K+ GitHub stars and is licensed under Apache-2.0.

Key Features

Source: GitHub README

  • Everything as Code and from the UI: keep workflows as code with a Git Version Control integration, even when building them from the UI.
  • Event-Driven & Scheduled Workflows: automate both scheduled and real-time event-driven workflows via a simple trigger definition.
  • Declarative YAML Interface: define workflows using a simple configuration in the built-in code editor.
  • Rich Plugin Ecosystem: hundreds of plugins built in to extract data from any database, cloud storage, or API, and run scripts in any language.
  • Intuitive UI & Code Editor: build and visualize workflows directly from the UI with syntax highlighting, auto-completion and real-time syntax validation.
  • Scalable: designed to handle millions of workflows, with high availability and fault tolerance.
  • Version Control Friendly: write your workflows from the built-in code Editor and push them to your preferred Git branch directly from Kestra, enabling best practices with CI/CD pipelines and version control systems.

Getting Started

Source: GitHub README

Deploy Kestra on Google Cloud Infrastructure Manager using our Terraform module.

Normalized Features

Source: tool-features-normalized.json

docker, docker compose, kubernetes, plugins, redis.

Features

Integrations & APIs

  • Plugin / Extension System