Skip to main content
The Elementary Python SDK provides a simple API for sending data quality information to Elementary Cloud. This page provides an overview of the API structure and endpoints.

Getting Your API Credentials

Before initializing the client, you need to obtain your API credentials from Elementary Cloud.

Generate an Access Token

You can generate tokens directly from the Elementary UI:
  1. Go to User → Personal Tokens or Account → Account Tokens
  2. Click Generate token
  3. (Optional) Add a name/description for the token
  4. Copy the token and store it securely — it is shown only once

Security

  • User tokens are user-scoped bearer tokens and inherit your workspace permissions
  • Account tokens are account-scoped bearer tokens with “Can View” permissions
  • Treat tokens like passwords — do not share or commit them to version control
  • Keep them secret, rotate regularly, and revoke immediately if compromised
For more details, see the MCP Setup Guide which uses the same token generation process.

Client Initialization

The SDK uses ElementaryCloudClient to send data to Elementary Cloud:
Where:
  • project_id is your Python project identifier (chosen by you, used to identify assets and tests belonging to this project across runs)
  • api_key is your API token (generated from the steps above)
  • url is the full SDK ingest endpoint URL (the Elementary team will provide you with this URL): {base_url}/sdk-ingest/{env_id}/batch
    • Example: https://prod.api.elementary-data.com/sdk-ingest/a6b2425d-36e2-4e13-8458-9825688ca1f2/batch
  • replace_existing_data (optional, default False) — controls how each batch is handled on the cloud side:
    • False (default): each batch is merged into existing data. Assets and tests not present in a given call are left untouched. Assets and tests that have not been reported for approximately one month are removed automatically.
    • True: each batch is treated as the complete set of assets and tests for the project. Assets and tests previously sent but absent from the current batch are removed immediately on the cloud side.
Use replace_existing_data=True only if every run of this client submits the full set of assets and tests for the project. If your runs cover a subset of assets, leave this as False (the default) to avoid data loss.

Test Context

Tests are run within an elementary_test_context which automatically captures test results:

raise_on_error

By default, elementary_test_context uses raise_on_error=False. This means that if a decorated test (or something inside the context) raises an exception, the SDK captures it and records an ERROR execution so you can still send results to Elementary Cloud without crashing your pipeline. If you prefer fail-fast behavior (for example in CI), pass raise_on_error=True to re-raise exceptions after they are recorded:

Test Decorators

The SDK provides decorators to define tests:
  • @boolean_test - For tests that return True/False (pass/fail)
  • @expected_range - For tests that return numeric values within a range
  • @expected_values - For tests that return values matching a list of expected values
  • @row_count - For tests that return a Sized object (DataFrame, list, etc.) to check row count

Context Manager Approach

You can also use context managers for inline tests:

Supported Objects

The SDK supports reporting table assets and test results.

Table Assets

Register tables and views in your data warehouse

Test Decorators

Define data quality tests using decorators

Sending Results

After running tests in a context, send results to Elementary Cloud:
This automatically batches all test results from the context and sends them in a single request.

Sending results for multiple assets

Each elementary_test_context holds one asset, so when your project monitors several tables you’ll have one context per asset. Pass them together in a single send_to_cloud call instead of calling it once per asset:
This matters most when replace_existing_data=True: sending one context at a time would cause each call to remove assets reported by the previous call. Passing all contexts together ensures the full set of assets and tests reaches the cloud in one atomic batch.
If the same asset or test appears in more than one context, it is deduplicated — only the first occurrence is sent. All test executions are always kept, so the same test run against two contexts will produce two execution records.

Error Handling

The SDK handles errors automatically, but you can wrap calls in try-except blocks:

Best Practices

  • One context per asset, one send call per project run — Open one elementary_test_context per asset, then pass all contexts to a single send_to_cloud call.
  • Use descriptive test names — Clear names help identify tests in the Elementary UI.
  • Include asset metadata — Add descriptions, owners, tags, and dependencies to assets.

Next Steps