What is dbt?
dbt enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. Analysts write select statements, called models, and dbt turns them into tables and views in a data warehouse. It also manages the relationships between models.
The dbt-core repository has changed shape. Its main branch now holds the Apache 2.0 source code of dbt v2.0, a ground-up rewrite in Rust that is distributed as a single self-contained binary with no Python runtime or dependency management. dbt v2.0 produces Parquet artifacts that can be queried and analyzed, and the JSON artifacts continue to be produced for backward compatibility. The v1 Python implementation lives on the 1.latest branch.
The company behind dbt is dbt Labs, which describes its mission as empowering data practitioners to create and disseminate organizational knowledge. It is described as a Philadelphia startup that pioneered the practice of modern analytics engineering. The README also notes that the dbt distribution, with dbt-specific customizations, is released under a separate dbt product license.
Key capabilities
- Models written as select statements that dbt builds into tables and views.
- Management of the relationships between models.
- Source code under Apache 2.0 in the dbt-core repository.
- dbt v2.0 as a single self-contained binary.
- Parquet artifacts for analyzing a dbt project.
Where dbt fits
- SQL transformation Write models as SQL select statements that dbt builds into tables and views in your warehouse.
- Validation Native SQL comprehension and local validation catch issues before they reach the warehouse.
- Lineage Interactive lineage across projects and columns, with column-level detail.
- Refactoring Rename a model or column once and dbt updates every downstream reference.
- Catalog and metadata Rich metadata powers dbt Catalog and lineage for governance.
- Artifacts Dbt v2.0 produces Parquet artifacts that can be queried and joined for analysis.
- Cost control Helps teams spot inefficiencies, automate routine work and use compute more efficiently.
- Data handling Dbt never stores your data; it works with the warehouse where the data lives.
Reviews of dbt
Be the first to share your experience with dbt.
Write a review
Loading review form…
Found dbt useful? Upvote it todayYour vote helps other IT teams find it in the daily ranking.
