You will connect Elementary Cloud to Databricks for syncing the Elementary schema (created by the Elementary dbt package).

Create service principal

  1. In your Databrick console, go to the admin settings by clicking your username in the to right corner -> Admin settings (add photo)
Admin settings
  1. Go to the Service principals tab, then click Add service principal (add photo)
Service principal settings
  1. Give the service principal a good name (e.g elementary) and click Add (add photo)
Add service principal
  1. Then, from the service principal configuration view, copy the Application Id (add photo)
Service principal ID
  1. Finally, run the following query:
GRANT SELECT ON SCHEMA <elementary_schema> TO `<service_principal_id>`;

Make sure to replace the <elementary_schema> and <service_principal_id> placeholders with the correct values

Permissions and security

Elementary cloud doesn't require read permissions to your tables and schemas, but only the following:

  • Read-only access to the elementary schema.
  • Access to read metadata in information schema and query history, related to the tables in your dbt project.

It is recommended to create a user using the instructions specified above to avoid granting excess privileges. For more details, refer to security and privacy.

Fill the connection form

Provide the following fields:

  • Host: The hostname of your Databricks account to connect to.
  • Http path: The path to the Databricks cluster or SQL warehouse.
  • Token: The token you generated for Elementary. For more information, see Generate a token in the Databricks docs.
  • Catalog (optional): The name of the Databricks Catalog.
  • Elementary schema: The name of your Elementary schema. Usually [schema name]_elementary.

Add the Elementary IP to allowlist

Elementary IP for allowlist:

Need help with onboarding?

We can provide support on Slack or hop on an onboarding call.