Hugging Face - Datasets
Import datasets from Hugging Face (https://huggingface.co/datasets)
You can only import datasets with Parquet exports using this connector.
The connector reads data through the Hugging Face dataset viewer API (https://datasets-server.huggingface.co). Anonymous requests are rate limited per IP address. Larger dataset syncs may therefore fail with 429 Too Many Requests unless you provide a Hugging Face user token. Private and gated datasets always require a token with access to the dataset.
Configuration
| Input | Type | Description | Default Value |
|---|---|---|---|
dataset_name | string | Dataset Name. | |
dataset_subsets | array | Dataset Subsets. Dataset Subsets to import. Will import all of them if nothing is provided (see https://huggingface.co/docs/dataset-viewer/en/configs_and_splits for more details) | |
dataset_splits | array | Dataset Splits. Splits to import. Will import all of them if nothing is provided (see https://huggingface.co/docs/dataset-viewer/en/configs_and_splits for more details) | |
api_token | string | Hugging Face API Token. Optional for public datasets, but required for private or gated datasets and strongly recommended to avoid anonymous per-IP rate limits (see https://huggingface.co/docs/hub/en/rate-limits). Create one at https://huggingface.co/settings/tokens. |
Streams
| Stream Name | Primary Key | Pagination | Supports Full Sync | Supports Incremental |
|---|---|---|---|---|
| rows | DefaultPaginator | ✅ | ❌ | |
| splits | No pagination | ✅ | ❌ |
IP allow list
If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.
Changelog
Expand to review
| Version | Date | Pull Request | Subject |
|---|---|---|---|
| 0.0.71 | 2026-11-10 | 91558 | Update dependencies |
| 0.0.70 | 2026-11-03 | 90599 | Update dependencies |
| 0.0.69 | 2026-10-27 | 89948 | Update dependencies |
| 0.0.68 | 2026-10-20 | 89269 | Update dependencies |
| 0.0.67 | 2026-10-13 | 88676 | Update dependencies |
| 0.0.66 | 2026-10-07 | PR | Add optional Hugging Face API token, honor rate-limit headers with longer 429 backoff, and surface clear 401/404 errors |
| 0.0.65 | 2026-10-06 | 87904 | Update dependencies |
| 0.0.64 | 2026-09-29 | 87224 | Update dependencies |
| 0.0.63 | 2026-09-22 | 86680 | Update dependencies |
| 0.0.62 | 2026-09-15 | 86089 | Update dependencies |
| 0.0.61 | 2026-09-08 | 85544 | Update dependencies |
| 0.0.60 | 2026-08-18 | 84611 | Update dependencies |
| 0.0.59 | 2026-08-11 | 83976 | Update dependencies |
| 0.0.58 | 2026-08-04 | 83490 | Update dependencies |
| 0.0.57 | 2026-07-28 | 82964 | Update dependencies |
| 0.0.56 | 2026-07-21 | 82457 | Update dependencies |
| 0.0.55 | 2026-07-14 | 81860 | Update dependencies |
| 0.0.54 | 2026-06-30 | 81111 | Update dependencies |
| 0.0.53 | 2026-06-23 | 80530 | Update dependencies |
| 0.0.52 | 2026-06-16 | 79903 | Update dependencies |
| 0.0.51 | 2026-06-09 | 79343 | Update dependencies |
| 0.0.50 | 2026-06-02 | 78783 | Update dependencies |
| 0.0.49 | 2026-04-28 | 77280 | Update dependencies |
| 0.0.48 | 2026-04-21 | 76633 | Update dependencies |
| 0.0.47 | 2026-03-31 | 75656 | Update dependencies |
| 0.0.46 | 2026-03-17 | 74523 | Update dependencies |
| 0.0.45 | 2026-03-03 | 73521 | Update dependencies |
| 0.0.44 | 2026-02-10 | 73049 | Update dependencies |
| 0.0.43 | 2026-01-20 | 71918 | Update dependencies |
| 0.0.42 | 2026-01-14 | 71724 | Update dependencies |
| 0.0.41 | 2025-12-18 | 70468 | Update dependencies |
| 0.0.40 | 2025-11-25 | 70018 | Update dependencies |
| 0.0.39 | 2025-11-18 | 69378 | Update dependencies |
| 0.0.38 | 2025-10-29 | 68799 | Update dependencies |
| 0.0.37 | 2025-10-21 | 68218 | Update dependencies |
| 0.0.36 | 2025-10-14 | 67867 | Update dependencies |
| 0.0.35 | 2025-10-07 | 67407 | Update dependencies |
| 0.0.34 | 2025-09-30 | 66397 | Update dependencies |
| 0.0.33 | 2025-09-09 | 66054 | Update dependencies |
| 0.0.32 | 2025-08-23 | 65368 | Update dependencies |
| 0.0.31 | 2025-08-09 | 64600 | Update dependencies |
| 0.0.30 | 2025-08-02 | 64206 | Update dependencies |
| 0.0.29 | 2025-07-26 | 63917 | Update dependencies |
| 0.0.28 | 2025-07-19 | 63503 | Update dependencies |
| 0.0.27 | 2025-07-12 | 63096 | Update dependencies |
| 0.0.26 | 2025-07-05 | 62652 | Update dependencies |
| 0.0.25 | 2025-06-21 | 61825 | Update dependencies |
| 0.0.24 | 2025-06-14 | 61131 | Update dependencies |
| 0.0.23 | 2025-05-24 | 60604 | Update dependencies |
| 0.0.22 | 2025-05-10 | 59877 | Update dependencies |
| 0.0.21 | 2025-05-03 | 59255 | Update dependencies |
| 0.0.20 | 2025-04-26 | 58760 | Update dependencies |
| 0.0.19 | 2025-04-19 | 57716 | Update dependencies |
| 0.0.18 | 2025-04-05 | 57037 | Update dependencies |
| 0.0.17 | 2025-03-29 | 56694 | Update dependencies |
| 0.0.16 | 2025-03-22 | 56059 | Update dependencies |
| 0.0.15 | 2025-03-08 | 55433 | Update dependencies |
| 0.0.14 | 2025-03-01 | 54762 | Update dependencies |
| 0.0.13 | 2025-02-22 | 54324 | Update dependencies |
| 0.0.12 | 2025-02-15 | 53812 | Update dependencies |
| 0.0.11 | 2025-02-08 | 53292 | Update dependencies |
| 0.0.10 | 2025-02-01 | 52789 | Update dependencies |
| 0.0.9 | 2025-01-25 | 52244 | Update dependencies |
| 0.0.8 | 2025-01-18 | 51820 | Update dependencies |
| 0.0.7 | 2025-01-11 | 51202 | Update dependencies |
| 0.0.6 | 2024-12-28 | 50621 | Update dependencies |
| 0.0.5 | 2024-12-21 | 50079 | Update dependencies |
| 0.0.4 | 2024-12-14 | 49609 | Update dependencies |
| 0.0.3 | 2024-12-12 | 49233 | Update dependencies |
| 0.0.2 | 2024-12-11 | 48911 | Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64 |
| 0.0.1 | 2024-11-28 | Initial release by @michel-tricot via Connector Builder |