Airbyte
Data Engineering & Orchestration
Airbyte is an open-source data movement platform that syncs data between systems, available as self-managed Airbyte Core or hosted Airbyte Cloud.
Self-hostedOpen sourceAPI availableProject source ↗
Start with data correctness and recovery. Connector count matters less than whether a pipeline handles schema drift, deletes, retries, state, backfills and partial failures for your actual sources and destinations.
For data engineers and platform teams building ingestion, transformation and orchestration workflows.
Implement one incremental pipeline with a schema change, failure and backfill. Measure operational work as well as throughput and latency.
Follow each source link for current information.
Data Engineering & Orchestration
Airbyte is an open-source data movement platform that syncs data between systems, available as self-managed Airbyte Core or hosted Airbyte Cloud.
Self-hostedOpen sourceAPI availableProject source ↗
Data Engineering & Orchestration
Dagster is an asset-based data orchestrator with lineage and quality signals per asset, and is now part of Prefect.
Self-hostedOpen sourceAPI availableProject source ↗
Data Engineering & Orchestration
Estuary unifies log-based CDC, streaming and batch ETL in one platform with 200+ connectors, priced by data moved and connector instances run.
See profileOpen sourceAPI availableFreemiumProject source ↗
Browser Automation & Scraping
MIT-licensed Python script that searches Google Maps in a visible Chromium window through Playwright and saves name, address, website, phone, ratings, service options and hours of each listing to CSV.
See profileOpen sourceAPI not specifiedProject source ↗
Data Engineering & Orchestration
Hatchet queues and runs background tasks, DAG workflows and durable tasks written with SDKs for Python, TypeScript, Go and Ruby. It adds retries, concurrency, rate limits, cron and a dashboard, self-hosted on PostgreSQL or as Hatchet Cloud.
Self-hostedOpen sourceAPI availableFreemiumProject source ↗
Data Engineering & Orchestration
RudderStack is a warehouse-native customer data platform that collects, governs, unifies and activates customer data, with an open source version.
Self-hostedOpen sourceAPI availableProject source ↗
Data Engineering & Orchestration
Temporal runs application logic as durable Workflows and Activities written with SDKs in Go, Java, Python, TypeScript, .NET, PHP, Ruby or Rust. The MIT-licensed server is self-hosted or used as the usage-priced Temporal Cloud.
Self-hostedOpen sourceAPI availableFreemiumProject source ↗