Advanced Analytica Advanced Analytica: IBOM
← All connectors
Local SQLite logo

Destination connector

Local SQLite

Send governed data into Local SQLite with a clear, practical setup guide.

Version 0.2.9 community alpha

Sqlite

:::danger

Use this destination on a local workstation. It won’t work on Kubernetes.

:::

Overview

This destination writes data to a file on the host’s local filesystem. By default, it writes data to /tmp/airbyte_local. To change this location, modify Airbyte’s LOCAL_ROOT environment variable.

:::caution

Make sure Docker Desktop can access /tmp. On MacOS, it also needs access to /private because /tmp links to /private. Otherwise, it won’t work. Allow access through “File sharing” in Settings -> Resources -> File sharing -> add the one or two above folder, then select “Apply & restart”.

:::

Sync overview

Output schema

Each stream is written to its own _airbyte_raw_{stream_name} table. Each table contains three columns:

  • _airbyte_ab_id: a uuid that Airbyte assigns to each processed event.
  • _airbyte_emitted_at: a timestamp showing when the event was pulled from the data source.
  • _airbyte_data: a json blob containing the event data.

Performance

Your filesystem’s write speed limits this integration’s performance.

Supported sync modes

Sync modeSupported?
Full Refresh - OverwriteYes
Full Refresh - AppendYes
Full Refresh - Overwrite + DedupedNo
Incremental Sync - AppendYes
Incremental Sync - Append + DedupedNo

Get started

The destination_path always starts with /local, whether you specify it or not. Any directory nesting within local maps to the local mount.

By default, the LOCAL_ROOT env variable in the .env file is set to /tmp/airbyte_local.

Docker mounts the local mount onto LOCAL_ROOT. This means /local is replaced by /tmp/airbyte_local by default.

Example

  • Set destination_path to /local/sqlite.db.
  • Use the /tmp/airbyte_local default for the local mount.
  • All data is then written to /tmp/airbyte_local/sqlite.db.

Access replicated data files

If Airbyte runs on your computer, open file:///tmp/airbyte_local in your browser to view the replicated data locally. If this fails, or Airbyte runs remotely, follow these steps to access the replicated files:

  1. Access the scheduler container using docker exec -it airbyte-server bash.
  2. Go to the default local mount using cd /tmp/airbyte_local.
  3. Go to the replicated file directory specified when you created the destination, using cd /{destination_path}.
  4. Run sqlite3 {filename} to access the data in a specific database file.

You can also copy the output file to your host machine. This command copies it to your current working directory:

docker cp airbyte-server:/tmp/airbyte_local/{destination_path} .

Note: If Airbyte runs on Windows with Docker backed by WSL2, follow similar steps or see link for an alternative approach.

Namespace support

This destination doesn’t support namespaces.

Changelog

Expand to review
VersionDatePull RequestSubject
0.2.92025-05-1059805Update dependencies
0.2.82025-05-0359348Update dependencies
0.2.72025-04-2658682Update dependencies
0.2.62025-04-1958261Update dependencies
0.2.52025-04-1257615Update dependencies
0.2.42025-04-0557113Update dependencies
0.2.32025-03-2956577Update dependencies
0.2.22025-03-2256104Update dependencies
0.2.12025-03-0843815Update dependencies
0.2.02025-03-0154897Update to Airbyte CDK 6 and Python 3.11
0.1.92024-08-2244530Update test dependencies
0.1.82024-07-0941098Update dependencies
0.1.72024-07-0640944Update dependencies
0.1.62024-06-2740215Replaced deprecated AirbyteLogger with logging.Logger
0.1.52024-06-2540323Update dependencies
0.1.42024-06-2240070Update dependencies
0.1.32024-06-0438975[autopull] Upgrade base image to v1.2.1
0.1.22024-05-2238539[autopull] base image + poetry + up_to_date
0.1.12024-05-2138539[autopull] base image + poetry + up_to_date
0.1.02022-07-2515018New SQLite destination
Advanced Analytica

Most businesses are sitting on information they can’t use at speed. The people who hold it are busy, and when they leave, the knowledge goes with them. The documents are static, and the processes around them weren’t designed for AI.

Advanced Analytica works with these businesses to turn that information into structured data assets. Once they're integrated, AI systems can govern it, and the business can use it. We bring in the strategy, the specification and the AI skills to rework how the business operates.

MOVE FAST. STAY SAFE.