Advanced Analytica Advanced Analytica: IBOM
← All connectors
Redis logo

Destination connector

Redis

Send governed data into Redis with a clear, practical setup guide.

Version 0.1.4 community alpha

Redis

Sync overview

Output schema

Airbyte structures incoming data based on the target Redis cache or data type. The connector maps incoming data from a namespace and stream to a unique Redis key.

For the hash implementation as a Redis data type, keys and hashes use this structure:

key:

namespace:stream:id

hash:

  • _airbyte_ab_id: Sequential id for a given key, generated using the INCR Redis command.
  • _airbyte_emitted_at: A timestamp showing when the event was received from the data source.
  • _airbyte_data: A json text/object containing the data received from the data source.

Performance

With enough cache memory, Redis should handle millions of records without issues. It stores data in memory and can periodically save snapshots to disk.

Supported sync modes

Sync modeSupported?
Full Refresh - OverwriteYes
Full Refresh - AppendYes
Full Refresh - Overwrite + DedupedNo
Incremental Sync - AppendYes
Incremental Sync - Append + DedupedNo

Getting started

Requirements

  • The connector is fully compatible with redis 2.8.x, 3.x.x and above.
  • Configuration
    • host: Hostname or address of the Redis server you want to connect to.
    • port: Port of the Redis server you want to connect to.
    • username: Username for authenticating with the Redis server.
    • password: Password for authenticating with the Redis server.
    • cache_type: Redis cache/data type for storing incoming messages, i.e hash,set,list,stream,etc.
  • Turn on SSL to connect using SSL.
  • For SSL Modes, select:
    • disable to disable encrypted communication between Airbyte and the source.
    • verify-full to always require encryption and verify the source’s identity.

Setup guide

This section hasn’t been written.

Namespace support

This destination supports namespaces.

Changelog

Expand to review
VersionDatePull RequestSubject
0.1.42022-10-25#18358TLS support
0.1.32022-10-18#17951Add SSH support
Advanced Analytica

Most businesses are sitting on information they can’t use at speed. The people who hold it are busy, and when they leave, the knowledge goes with them. The documents are static, and the processes around them weren’t designed for AI.

Advanced Analytica works with these businesses to turn that information into structured data assets. Once they're integrated, AI systems can govern it, and the business can use it. We bring in the strategy, the specification and the AI skills to rework how the business operates.

MOVE FAST. STAY SAFE.