Advanced Analytica Advanced Analytica: IBOM
← All connectors
SelectDB logo

Destination connector

SelectDB

Send governed data into SelectDB with a clear, practical setup guide.

Version 0.1.0 archived alpha

SelectDB

The destination-selectdb destination is based on SelectDB copy into . It supports batch rollback and uses http/https put request.

Sync overview

Output schema

Each stream is written to its own SelectDB table. Each table contains three columns:

  • _airbyte_ab_id: a uuid that Airbyte assigns to each processed event. The column type in Doris is VARCHAR(40).
  • _airbyte_emitted_at: a timestamp showing when the event was pulled from the data source. The column type in Doris is BIGINT.
  • _airbyte_data: a json blob containing the event data. The column type in SelectDB is String.

Features

This section should contain a table in the following format:

FeatureSupported?(Yes/No)Notes
Full Refresh SyncYes
Incremental - Append SyncYes
Incremental - Append + DedupedNo
For databases, WAL/Logical replicationYes

Performance considerations

Writes are processed in batches. mini records may affect performance.

Importing multiple tables generates multiple transactions. Split these transactions as much as possible.

Getting started

Requirements

To use the SelectDB destination, you’ll need:

  • A SelectDB server and your
  • Ensure Airbyte can access your SelectDB http port and mysql query port.
  • Ensure Airbyte can access your SelectDB host.
  • If you use a public network, add your airbyte public network IP to your SelectDB ip whitelist.
  • Ensure your SelectDB user has read/write permissions for the relevant tables.

Target database and tables

Choose a database to store data synced from Airbyte.

Prepare this database before syncing. Match the table’s column names and their order as closely as possible.

Set up access parameters

  • loadURL
  • jdbcURL
  • clustername
  • username
  • password
  • database

Changelog

Expand to review
VersionDatePull RequestSubject
0.1.02023-04-03#20881Initial release SelectDB Destination
Advanced Analytica

Most businesses are sitting on information they can’t use at speed. The people who hold it are busy, and when they leave, the knowledge goes with them. The documents are static, and the processes around them weren’t designed for AI.

Advanced Analytica works with these businesses to turn that information into structured data assets. Once they're integrated, AI systems can govern it, and the business can use it. We bring in the strategy, the specification and the AI skills to rework how the business operates.

MOVE FAST. STAY SAFE.