Advanced Analytica Advanced Analytica: IBOM
← All connectors
The Guardian API logo

Source connector

The Guardian API

Set up The Guardian API as a source and move its data into your chosen destination.

Version 0.2.27 community alpha

The Guardian API

Overview

Sync data from the The Guardian with The Guardian API source.

Requirements

You’ll need an API key to access the API. Send this key with every request. Visit this link to register for an API key.

You can provide the following optional parameters to the connector:


q (query)

Use the q (query) parameter to show only results containing that search term. The q parameter supports AND, OR and NOT operators. For example, search the Guardian for content about political debates: https://content.guardianapis.com/search?q=debates

The q parameter shows only results containing that search term. This search returns many results, so you can narrow the response to more meaningful content. For example, you can find political content published in 2014: https://content.guardianapis.com/search?q=debate&tag=politics/politics&from-date=2014-01-01&api-key=test


tag

A tag is data used to categorise content. All Guardian content is manually categorised using more than 50,000 tags. Use this parameter to show only results matching the entered tag. See here for all tags and here for the tags endpoint documentation.


section

Use this parameter to show results from a specific section. See here for all sections and here for the sections endpoint documentation.


order-by

Use this parameter to sort results by newest, oldest or relevance. To enable incremental syncs, set order-by to oldest.


start_date

Use this parameter to set the results’ minimum date in YYYY-MM-DD format. Results older than the start_date won’t appear.


end_date

Use this parameter to set the results’ maximum date in YYYY-MM-DD format. Results newer than the end_date won’t appear. For incremental syncs, the default is the current date (today).


Output schema

Content item structure

{
    "id": "string",
    "type": "string"
    "sectionId": "string"
    "sectionName": "string"
    "webPublicationDate": "string"
    "webTitle": "string"
    "webUrl": "string"
    "apiUrl": "string"
    "isHosted": "boolean"
    "pillarId": "string"
    "pillarName": "string"
}

The source can sync the content stream.

Setup guide

Step 1: Set up The Guardian API connector in Airbyte

Airbyte Cloud

  1. Log into your Airbyte Cloud account.
  2. Select Sources from the left navigation bar. Then, select +new source in the top-right corner.
  3. On the Set up the source page, select The Guardian API from the Source type dropdown.
  4. Enter your mandatory api_key and any optional parameters you need.
  5. Select Set up source.

Airbyte OSS

  1. Go to the Airbyte Open Source dashboard.
  2. Set your source name to The Guardian API.
  3. Enter your mandatory api_key and any optional parameters you need.
  4. Select Set up source.

Supported sync modes

The Guardian API source connector supports these sync modes:

FeatureSupported?
Full Refresh SyncYes
Incremental SyncYes
NamespacesNo

Performance considerations

Your assigned key is rate-limited. Applications making many polling requests may exceed their daily quota. Further requests will then be blocked until the next period begins. A free developer key allows up to 1 call per second and 500 calls per day. The connector requests 50 results per page, which is the API maximum. It splits the date range into 7-day windows. A large initial sync covering several years may therefore need to run across multiple days.

IP allow list

If you use Airbyte Cloud and restrict access to specific IPs, add the Airbyte Cloud IP addresses to your allow list.

Changelog

Expand to review
VersionDatePull RequestSubject
0.2.272026-10-0788327Fix pagination requesting page 1 twice (duplicate records) and send page-size=50 as a query parameter instead of an ignored request body; document incremental sync support
0.2.262025-05-2560501Update dependencies
0.2.252025-05-1060109Update dependencies
0.2.242025-05-0459627Update dependencies
0.2.232025-04-2758436Update dependencies
0.2.222025-04-2258596Manifest cleanup
0.2.212025-04-1257938Update dependencies
0.2.202025-04-0557416Update dependencies
0.2.192025-03-2956904Update dependencies
0.2.182025-03-2256262Update dependencies
0.2.172025-03-0855644Update dependencies
0.2.162025-03-0155113Update dependencies
0.2.152025-02-2254515Update dependencies
0.2.142025-02-1554044Update dependencies
0.2.132025-02-0853584Update dependencies
0.2.122025-02-0153036Update dependencies
0.2.112025-01-2552381Update dependencies
0.2.102025-01-1851417Update dependencies
0.2.92025-01-1350855Update to latest CDK and fix custom pagination strategy
0.2.82024-12-2850818Update dependencies
0.2.72024-12-2150341Update dependencies
0.2.62024-12-1449797Update dependencies
0.2.52024-12-1249378Update dependencies
0.2.42024-12-1148790Add unit tests for custom components
0.2.32024-12-1148201Starting with this version, the Docker image is now rootless. Please note that this and future versions will not be compatible with Airbyte versions earlier than 0.64
0.2.22024-10-2947779Update dependencies
0.2.12024-10-2847456Update dependencies
0.2.02024-09-0645195Refactor connector to manifest-only format
0.1.92024-08-3144997Update dependencies
0.1.82024-08-2444746Update dependencies
0.1.72024-08-1744208Update dependencies
0.1.62024-08-1043540Update dependencies
0.1.52024-08-0342781Update dependencies
0.1.42024-07-2042316Update dependencies
0.1.32024-07-1341878Update dependencies
0.1.22024-07-1041505Update dependencies
0.1.12024-07-1041049Migrate to poetry
0.1.02022-10-3018654🎉 New Source: The Guardian API [low-code CDK]
Advanced Analytica

Most businesses are sitting on information they can’t use at speed. The people who hold it are busy, and when they leave, the knowledge goes with them. The documents are static, and the processes around them weren’t designed for AI.

Advanced Analytica works with these businesses to turn that information into structured data assets. Once they're integrated, AI systems can govern it, and the business can use it. We bring in the strategy, the specification and the AI skills to rework how the business operates.

MOVE FAST. STAY SAFE.