Data warehouses
Connect to Databricks
You will connect Elementary Cloud to Databricks for syncing the Elementary schema (created by the Elementary dbt package).
Create service principal
- In your Databrick console, go to the admin settings by clicking your username in the to right corner -> Admin settings (add photo)
- Go to the Service principals tab, then click Add service principal (add photo)
- Give the service principal a good name (e.g elementary) and click Add (add photo)
- Then, from the service principal configuration view, copy the Application Id (add photo)
- Finally, run the following query:
Make sure to replace the <elementary_schema>
and <service_principal_id>
placeholders with the correct values
Permissions and security
Elementary cloud doesn't require read permissions to your tables and schemas, but only the following:
- Read-only access to the elementary schema.
- Access to read metadata in information schema and query history, related to the tables in your dbt project.
It is recommended to create a user using the instructions specified above to avoid granting excess privileges. For more details, refer to security and privacy.
Fill the connection form
Provide the following fields:
- Host: The hostname of your Databricks account to connect to.
- Http path: The path to the Databricks cluster or SQL warehouse.
- Token: The token you generated for Elementary. For more information, see Generate a token in the Databricks docs.
- Catalog (optional): The name of the Databricks Catalog.
- Elementary schema: The name of your Elementary schema. Usually
[schema name]_elementary
.
Add the Elementary IP to allowlist
Elementary IP for allowlist: 3.126.156.226
Need help with onboarding?
We can provide support on Slack or hop on an onboarding call.