Dremio
Overview
The Dremio source supports Full Refresh sync of catalogue metadata from a self-hosted Dremio instance. It doesn’t replicate rows from the tables listed in the catalogue.
Output schema
This source provides the following output stream:
- Catalogs (Full table)
To request Airbyte support for more endpoints, use create an issue.
Features
| Feature | Supported? |
|---|---|
| Full Refresh Sync | Yes |
| Incremental - Append Sync | No |
| SSL connection | Yes |
| Namespaces | No |
Get started
Requirements
- A valid Dremio authentication token
- The base URL of a self-hosted Dremio instance reachable from Airbyte
Setup
You need a self-hosted Dremio instance to access the Dremio REST API used by this source. See the Dremio Deployment Models document, or review Dremio OSS for reference.
- Set Base URL to your self-hosted Dremio instance URL, including the scheme and port when needed. For example,
https://dremio.example.com:9047. Don’t include/api/v3/catalog. The connector appends that path. - Generate an authentication token by following Dremio’s authentication instructions.
- Set API Key to the returned
tokenvalue, without anAuthorization,Bearer, or_dremioprefix. The connector adds the_dremioprefix.
:::warning Self-hosted Dremio only
Replace the prefilled https://app.dremio.cloud URL with your self-hosted instance URL. The prefilled URL opens the Dremio Cloud web application, not the self-hosted REST API. Dremio Cloud uses a different, project-scoped API, which this connector doesn’t support.
:::
Fix unauthorised errors
Dremio authentication tokens generated by /apiv2/login expire after 30 hours. If the connection check reports that the catalogs stream is unauthorised, generate a new token and update API Key. Check that the token belongs to the instance in Base URL and doesn’t already contain the _dremio prefix. See Dremio API authentication for token details.
IP allow list
If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.2.25 | 2026-10-07 | 88209 | Send catalog Content-Type as a header and clarify self-hosted authentication setup |
| 0.2.24 | 2025-05-24 | 60358 | Update dependencies |
| 0.2.23 | 2025-05-10 | 59965 | Update dependencies |
| 0.2.22 | 2025-05-03 | 59375 | Update dependencies |
| 0.2.21 | 2025-04-26 | 58837 | Update dependencies |
| 0.2.20 | 2025-04-19 | 58323 | Update dependencies |
| 0.2.19 | 2025-04-12 | 57840 | Update dependencies |
| 0.2.18 | 2025-04-05 | 57243 | Update dependencies |
| 0.2.17 | 2025-03-29 | 56491 | Update dependencies |
| 0.2.16 | 2025-03-22 | 55976 | Update dependencies |
| 0.2.15 | 2025-03-08 | 55339 | Update dependencies |
| 0.2.14 | 2025-03-01 | 54456 | Update dependencies |
| 0.2.13 | 2025-02-15 | 53777 | Update dependencies |
| 0.2.12 | 2025-02-08 | 53335 | Update dependencies |
| 0.2.11 | 2025-02-01 | 52837 | Update dependencies |
| 0.2.10 | 2025-01-25 | 52330 | Update dependencies |
| 0.2.9 | 2025-01-18 | 51690 | Update dependencies |
| 0.2.8 | 2025-01-11 | 51124 | Update dependencies |
| 0.2.7 | 2024-12-28 | 50558 | Update dependencies |
| 0.2.6 | 2024-12-21 | 50029 | Update dependencies |
| 0.2.5 | 2024-12-14 | 49529 | Update dependencies |
| 0.2.4 | 2024-12-12 | 49194 | Update dependencies |
| 0.2.3 | 2024-12-11 | 48904 | Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64 |
| 0.2.2 | 2024-10-29 | 47886 | Update dependencies |
| 0.2.1 | 2024-10-28 | 47633 | Update dependencies |
| 0.2.0 | 2024-08-19 | 44415 | Refactor connector to manifest-only format |
| 0.1.15 | 2024-08-17 | 44311 | Update dependencies |
| 0.1.14 | 2024-08-12 | 43785 | Update dependencies |
| 0.1.13 | 2024-08-10 | 43608 | Update dependencies |
| 0.1.12 | 2024-08-03 | 43201 | Update dependencies |
| 0.1.11 | 2024-07-27 | 42670 | Update dependencies |
| 0.1.10 | 2024-07-20 | 42186 | Update dependencies |
| 0.1.9 | 2024-07-17 | 38692 | Make compatible with builder |
| 0.1.8 | 2024-07-13 | 41812 | Update dependencies |
| 0.1.7 | 2024-07-10 | 41578 | Update dependencies |
| 0.1.6 | 2024-07-09 | 41127 | Update dependencies |
| 0.1.5 | 2024-07-06 | 41008 | Update dependencies |
| 0.1.4 | 2024-06-25 | 40471 | Update dependencies |
| 0.1.3 | 2024-06-22 | 40045 | Update dependencies |
| 0.1.2 | 2024-06-06 | 39235 | [autopull] Upgrade base image to v1.2.2 |
| 0.1.1 | 2024-05-21 | 38497 | [autopull] base image + poetry + up_to_date |
| 0.1.0 | 2022-12-01 | 19912 | New Source: Dremio |