DORSETRIGS
Home

dbt (34 post)


posts by category not found!

dbt source not being found in dbt run

Dbt Source Not Found Error A Troubleshooting Guide Ever encountered the dreaded Source not found error while running your dbt models This frustrating issue can

2 min read 05-10-2024 39
dbt source not being found in dbt run
dbt source not being found in dbt run

Reuse columns in dbt model

Reusing Columns in dbt Models Streamlining Your Data Transformations Tired of repeating the same data transformations in your dbt models Its a common pain point

2 min read 05-10-2024 59
Reuse columns in dbt model
Reuse columns in dbt model

Disable elementary from DBT CLI when running dbt test

Ditching Elementary for DBT Tests A Guide to Efficient Testing When working with dbt you might find yourself wanting to run tests without the extra overhead of

2 min read 05-10-2024 45
Disable elementary from DBT CLI when running dbt test
Disable elementary from DBT CLI when running dbt test

"dbt constraints" package is not accepting conditional arguments

Understanding the dbt constraints Package Conditional Arguments Issue In the world of data transformation dbt data build tool has become a cornerstone for analy

2 min read 24-09-2024 57
"dbt constraints" package is not accepting conditional arguments
"dbt constraints" package is not accepting conditional arguments

Extract JSON array from object (redshift)

Extracting JSON Arrays from Objects in Amazon Redshift In todays data driven world managing and manipulating JSON data has become crucial for many businesses Am

3 min read 24-09-2024 69
Extract JSON array from object (redshift)
Extract JSON array from object (redshift)

How to get the dependencies of a model in dbt in terms of a table

How to Get the Dependencies of a Model in dbt in Terms of a Table In the world of data transformation understanding the dependencies between models in dbt data

2 min read 23-09-2024 59
How to get the dependencies of a model in dbt in terms of a table
How to get the dependencies of a model in dbt in terms of a table

ImportError: cannot import name 'Credentials' from 'dbt.adapters.base'

Understanding and Resolving Import Error Cannot Import Name Credentials from dbt adapters base When working with the dbt data build tool library in Python you m

2 min read 20-09-2024 64
ImportError: cannot import name 'Credentials' from 'dbt.adapters.base'
ImportError: cannot import name 'Credentials' from 'dbt.adapters.base'

Cannot downgrade numpy version under dbt-fal

How to Handle Downgrade Issues with Num Py in dbt fal When working with data transformation tools like dbt fal you might encounter a situation where you cannot

2 min read 20-09-2024 52
Cannot downgrade numpy version under dbt-fal
Cannot downgrade numpy version under dbt-fal

UDF in Snowpark + DBT gives ModuleNotFoundError with group_by().apply_in_pandas()

Understanding the Module Not Found Error in Snowpark with DBT Using UDFs and group by apply in pandas Introduction When working with Snowpark and dbt data build

3 min read 19-09-2024 70
UDF in Snowpark + DBT gives ModuleNotFoundError with group_by().apply_in_pandas()
UDF in Snowpark + DBT gives ModuleNotFoundError with group_by().apply_in_pandas()

Why do I get "module could not be found" when trying to connect dbt to an SQLite database?

Troubleshooting Module Could Not Be Found Error When Connecting DBT to SQ Lite When working with dbt Data Build Tool you may encounter an error that states modu

2 min read 19-09-2024 51
Why do I get "module could not be found" when trying to connect dbt to an SQLite database?
Why do I get "module could not be found" when trying to connect dbt to an SQLite database?

Get jinja2 macro parameter names in dbt?

How to Retrieve Jinja2 Macro Parameter Names in dbt When working with dbt data build tool you often employ Jinja2 macros to enhance the flexibility and reusabil

2 min read 19-09-2024 49
Get jinja2 macro parameter names in dbt?
Get jinja2 macro parameter names in dbt?

Snowflake Dynamic Tables dbt core

Understanding Snowflake Dynamic Tables with dbt Core Dynamic tables in Snowflake can significantly enhance the data transformation process This article will pro

3 min read 16-09-2024 49
Snowflake Dynamic Tables dbt core
Snowflake Dynamic Tables dbt core

Run a model and store its value to a variable

How to Run a Model and Store Its Value in a Variable When working on data analysis or machine learning projects one common task is to run a model and save the r

2 min read 14-09-2024 52
Run a model and store its value to a variable
Run a model and store its value to a variable

partition_by not working in dbt python model

Troubleshooting partition by in DBT Python Models When working with DBT Data Build Tool and Python models many users encounter issues with the partition by func

2 min read 14-09-2024 97
partition_by not working in dbt python model
partition_by not working in dbt python model

Is changing date partitionning granularity a breaking change?

Changing Date Partitioning Granularity A Potential Breaking Change Partitioning by date is a common strategy for optimizing query performance and managing data

2 min read 13-09-2024 58
Is changing date partitionning granularity a breaking change?
Is changing date partitionning granularity a breaking change?

Complex loop calc in dbt + postgres

Unraveling Complex Loop Calculations in dbt Postgre SQL dbt data build tool empowers data analysts to write clean maintainable and reusable data transformations

3 min read 13-09-2024 53
Complex loop calc in dbt + postgres
Complex loop calc in dbt + postgres

How to pass variable to post_hook in dbt?

Dynamically Dropping Tables in dbt A Deep Dive with Post Hooks and Variable Management dbts post hooks offer a powerful way to execute additional SQL statements

3 min read 04-09-2024 84
How to pass variable to post_hook in dbt?
How to pass variable to post_hook in dbt?

DBT - environment variables and running dbt

Mastering dbt Environment Variables A Guide for Beginners dbt Data Build Tool is a powerful tool for data transformation and modeling A key feature of dbt is it

2 min read 04-09-2024 98
DBT - environment variables and running dbt
DBT - environment variables and running dbt

DBT Spark on EMR using AWS Glue Data Catalog

Leveraging DBT Spark with AWS Glue Data Catalog Building a Modern Lakehouse on EMR The world of data warehousing is rapidly shifting towards lakehouse architect

2 min read 02-09-2024 88
DBT Spark on EMR using AWS Glue Data Catalog
DBT Spark on EMR using AWS Glue Data Catalog

Should WASB be used to mount Azure Blob Storage in Databricks?

Should WASB be used to mount Azure Blob Storage in Databricks The use of WASB Azure Web HDFS to mount Azure Blob Storage in Databricks is a complex issue with e

2 min read 02-09-2024 53
Should WASB be used to mount Azure Blob Storage in Databricks?
Should WASB be used to mount Azure Blob Storage in Databricks?

How to configure sqlfluff to lint the Model Configuration

Linting Your dbt Model Configurations with SQL Fluff dbt data build tool is a popular tool for building data pipelines and transforming data While dbt focuses o

2 min read 02-09-2024 67
How to configure sqlfluff to lint the Model Configuration
How to configure sqlfluff to lint the Model Configuration

Replacement newer image for fishtownanalytics/dbt:1.0.0

Migrating from fishtownanalytics dbt 1 0 0 to the Latest dbt Image The fishtownanalytics dbt 1 0 0 image is indeed deprecated This is because the dbt project ha

2 min read 02-09-2024 46
Replacement newer image for fishtownanalytics/dbt:1.0.0
Replacement newer image for fishtownanalytics/dbt:1.0.0

I'm trying to set dbt_valid_from column to 2023 for the first load

Setting dbt valid from for Initial Loads A Guide to Time Based Data Modeling When building historical data models with dbt the dbt valid from and dbt valid to c

2 min read 01-09-2024 49
I'm trying to set dbt_valid_from column to 2023 for the first load
I'm trying to set dbt_valid_from column to 2023 for the first load

Fetching return value of dbt macro in airflow

Fetching Return Values from dbt Macros in Airflow This article explores how to retrieve the return value of a dbt macro within an Airflow workflow using the Dbt

2 min read 01-09-2024 50
Fetching return value of dbt macro in airflow
Fetching return value of dbt macro in airflow

ClassCastException in Spark SQL Incremental Load with DBT

Troubleshooting Class Cast Exception in Spark SQL Incremental Load with DBT This article explores a common issue encountered when implementing incremental loads

3 min read 01-09-2024 53
ClassCastException in Spark SQL Incremental Load with DBT
ClassCastException in Spark SQL Incremental Load with DBT