How to Connect Starburst/Trino with dbt Core?
To connect to Starburst/Trino with dbt Core, you need to create a profile and target YAML keys/values in the profiles.yml configuration file for your Starburst/Trino clusters. This dbt YAML file is located in the .dbt/ directory of your user/home directory.
- Starburst/Trino connection: The connection to Starburst/Trino is established through the profiles.yml configuration file. This file contains the necessary keys/values that allow dbt Core to interact with your Starburst/Trino clusters.
- Location of dbt YAML file: The dbt YAML file, which is crucial for the connection, is located in the .dbt/ directory of your user/home directory.
- Creating a profile: A profile needs to be created in dbt Core to facilitate the connection with Starburst/Trino. This profile contains the necessary configuration settings for the connection.
What Platforms does dbt-trino Adapter Support?
The dbt-trino adapter supports Starburst Galaxy, Starburst Enterprise platform (SEP), and Trino. You can use dbt Cloud to connect with Starburst Galaxy, Starburst Enterprise, and self-hosted Trino.
- Starburst Galaxy: The dbt-trino adapter supports Starburst Galaxy, allowing you to connect and interact with this platform using dbt Cloud.
- Starburst Enterprise Platform (SEP): SEP is another platform supported by the dbt-trino adapter. You can connect to SEP using dbt Cloud.
- Trino: Trino, a self-hosted platform, is also supported by the dbt-trino adapter. You can connect to Trino using dbt Cloud.
What are the Prerequisites for Using dbt Cloud and Starburst Galaxy?
Here are some prerequisites for using dbt Cloud and Starburst Galaxy: You have a multi-tenant deployment in dbt Cloud, You have a Starburst Galaxy account, You have an AWS account with permissions to upload data to an S3 bucket.
- Multi-tenant deployment in dbt Cloud: One of the prerequisites for using dbt Cloud and Starburst Galaxy is having a multi-tenant deployment in dbt Cloud.
- Starburst Galaxy account: You also need to have a Starburst Galaxy account to use dbt Cloud and Starburst Galaxy.
- AWS account: An AWS account with permissions to upload data to an S3 bucket is also a prerequisite for using dbt Cloud and Starburst Galaxy.
How to Set Session Properties in Starburst Enterprise, Starburst Galaxy, or Trino Cluster?
You can set session properties to modify the current configuration for your user session with a Starburst Enterprise, Starburst Galaxy, or Trino cluster. The standard way to define session properties is with the session_properties field of your profiles.yml. This ensures that all dbt connections use these settings by default.
- Setting session properties: Session properties can be set to modify the current configuration for your user session with a Starburst Enterprise, Starburst Galaxy, or Trino cluster.
- Defining session properties: The standard way to define session properties is with the session_properties field of your profiles.yml.
- Default settings: Defining session properties in the profiles.yml ensures that all dbt connections use these settings by default.
What is the Role of the profiles.yml File in dbt Connections?
The profiles.yml file plays a crucial role in dbt connections. It contains the necessary keys/values that allow dbt Core to interact with your Starburst/Trino clusters. Furthermore, it is used to define session properties, ensuring that all dbt connections use these settings by default.
- Connection settings: The profiles.yml file contains the necessary keys/values that allow dbt Core to interact with your Starburst/Trino clusters.
- Session properties: The profiles.yml file is also used to define session properties, which modify the current configuration for your user session.
- Default settings: By defining session properties in the profiles.yml, all dbt connections use these settings by default.
How to Use dbt Cloud to Connect with Starburst Platforms and Trino?
You can use dbt Cloud to connect with Starburst Galaxy, Starburst Enterprise, and self-hosted Trino. To do this, you need to have a multi-tenant deployment in dbt Cloud, a Starburst Galaxy account, and an AWS account with permissions to upload data to an S3 bucket.
- dbt Cloud: dbt Cloud can be used to connect with Starburst Galaxy, Starburst Enterprise, and self-hosted Trino.
- Prerequisites: To use dbt Cloud for these connections, you need to have a multi-tenant deployment in dbt Cloud, a Starburst Galaxy account, and an AWS account.
- AWS account: The AWS account should have permissions to upload data to an S3 bucket.
Get the guide
