{
  "schema_version": 2,
  "id": "develop/ai/context-engine/data-integration",
  "title": "Redis Data Integration",
  "url": "https://redis.io/docs/latest/develop/ai/context-engine/data-integration/",
  "summary": "Keep Redis in sync with your primary databases so AI agents always have access to fresh, accurate business data.",
  "tags": [
    "docs",
    "develop",
    "ai"
  ],
  "last_updated": "2026-10-05T09:34:27+02:00",
  "children": [
    {
      "id": "develop/ai/context-engine/data-integration/interactive-demo",
      "summary": "Deploy an RDI pipeline for a PostgreSQL database, follow inserts, updates, and deletes into Redis, and change a table's keys with a job file.",
      "title": "Redis Data Integration interactive demo",
      "url": "https://redis.io/docs/latest/develop/ai/context-engine/data-integration/interactive-demo/"
    }
  ],
  "page_type": "content",
  "content_hash": "afed7fd6732a29a7c9e676176728c3174cae95c8d04484b7dbad4f5e8c8c7735",
  "sections": [
    {
      "id": "overview",
      "title": "Overview",
      "role": "overview",
      "text": "Stream live business data into Redis so agents always work with accurate, up-to-date information.\n\nRedis Data Integration (RDI) keeps your Redis Cloud database in sync with your existing relational databases using [Change data capture](https://en.wikipedia.org/wiki/Change_data_capture) (CDC). Agents query Redis at full speed without ever querying your production databases directly.\n\n<div class=\"grid grid-cols-1 md:grid-cols-3 gap-6 my-8\">\n  \n  \n  \n</div>"
    },
    {
      "id": "what-is-redis-data-integration",
      "title": "What is Redis Data Integration?",
      "role": "content",
      "text": "Redis Data Integration (RDI) is a pipeline service, available fully managed on Redis Cloud or self-managed on your own infrastructure, that:\n\n- **Syncs data in near real time**: Changes in your source database propagate to Redis within seconds using CDC\n- **Keeps agents away from source databases**: Agents query Redis at full speed, preserving performance and security\n- **Requires no coding**: Define pipelines through configuration; transformations are handled automatically\n- **Handles initial and streaming sync**: Full snapshot on first run, then continuous change capture from that point on\n- **Supports major relational databases**: Oracle, MySQL, PostgreSQL, MariaDB, SQL Server, and AWS Aurora"
    },
    {
      "id": "why-use-redis-data-integration",
      "title": "Why use Redis Data Integration?",
      "role": "content",
      "text": "<div class=\"grid grid-cols-1 md:grid-cols-2 gap-6 my-6\">\n  <div class=\"p-5 border border-redis-pen-300 rounded-lg\">\n    <h3 class=\"text-redis-ink-900 font-semibold mb-3\">For AI applications</h3>\n    <ul class=\"space-y-1 text-redis-pen-600\">\n      <li>Eliminate stale data: agents always see current business state</li>\n      <li>Millisecond query performance from Redis instead of slow source DB calls</li>\n      <li>No cache invalidation logic to write or maintain</li>\n      <li>Combine with Context Retriever for governed, always-fresh agent tools</li>\n    </ul>\n  </div>\n  <div class=\"p-5 border border-redis-pen-300 rounded-lg\">\n    <h3 class=\"text-redis-ink-900 font-semibold mb-3\">For developers</h3>\n    <ul class=\"space-y-1 text-redis-pen-600\">\n      <li>Configuration-driven: no custom ETL code required</li>\n      <li>Deploy fully managed on Redis Cloud or self-managed on your own infrastructure</li>\n      <li>~10,000 records per second per core for initial snapshots and streaming</li>\n      <li>At-least-once delivery guaranteed for every change in the defined dataset</li>\n    </ul>\n  </div>\n</div>"
    },
    {
      "id": "quick-example",
      "title": "Quick example",
      "role": "content",
      "text": "RDI pipelines are defined through configuration. You specify which source database tables to sync, how to map each row to a Redis key, and what transformations to apply. No custom code is required.\n\nSee the [RDI quick start](https://redis.io/docs/latest/operate/rc/rdi/quick-start) for a step-by-step walkthrough syncing a live PostgreSQL source to Redis Cloud.\n\nTo watch a pipeline sync a PostgreSQL database without setting one up, try the [interactive demo](https://redis.io/docs/latest/develop/ai/context-engine/data-integration/interactive-demo)."
    },
    {
      "id": "redis-data-integration-overview",
      "title": "Redis Data Integration overview",
      "role": "content",
      "text": "AI agents are only as reliable as the data they work with. RDI solves the freshness problem by using [Change Data Capture (CDC)](https://en.wikipedia.org/wiki/Change_data_capture) to detect changes in your source database and propagate them to Redis within seconds. Agents interact only with Redis, which is fast, predictable, and always current.\n\nRDI pipelines run in two phases:\n\n- **Initial sync**: Reads a full snapshot of your source data and loads it into the target Redis database.\n- **Streaming**: Captures changes as they happen and applies them to Redis within seconds of the source change.\n\n![A source database syncs to Redis through an initial sync and a continuous CDC stream. Redis serves the agent.](https://redis.io/docs/latest/images/ai/context-engine/rdi-sync-flow.svg)\n\nData is transformed from relational rows into Redis hashes or JSON documents as part of the pipeline, with no coding required. You define what data to sync and how to map it using configuration, and RDI handles the rest."
    },
    {
      "id": "why-agents-need-fresh-data",
      "title": "Why agents need fresh data",
      "role": "content",
      "text": "Without a reliable data pipeline, agents face two common failure modes: stale cached data that no longer reflects reality, or slow queries to source databases that block agent responsiveness. RDI eliminates both by maintaining a continuously updated Redis cache that agents can query at full Redis speed."
    },
    {
      "id": "key-benefits",
      "title": "Key benefits",
      "role": "content",
      "text": "- **Near real-time updates**: Changes in your source database reach Redis within seconds using CDC.\n- **No direct database access**: Agents query Redis, not your production databases, preserving performance and security.\n- **No coding required**: Define pipelines through configuration. Transformations are handled automatically.\n- **Fully managed on Redis Cloud**: No infrastructure to provision or maintain.\n- **High throughput**: Processes approximately 10,000 records per second per core for initial snapshots and streaming.\n- **At-least-once delivery**: RDI guarantees every change in the defined dataset is delivered to Redis."
    },
    {
      "id": "supported-source-databases",
      "title": "Supported source databases",
      "role": "compatibility",
      "text": "RDI supports the following source databases when used with Redis Cloud:\n\n| Database | Versions |\n|----------|----------|\n| Oracle | 19c, 21c |\n| MySQL | 5.7, 8.0.x, 8.2 |\n| PostgreSQL | 10–16 |\n| MariaDB | 10.5, 11.4.3 |\n| AWS Aurora PostgreSQL | 15 |\n| SQL Server | 2017, 2019, 2022 |"
    },
    {
      "id": "get-started",
      "title": "Get started",
      "role": "content",
      "text": "**Redis Cloud:**\n\nRDI on Redis Cloud is available in preview for Redis Cloud Pro databases hosted on AWS.\n\nTo get started:\n\n1. [Prepare your source database](https://redis.io/docs/latest/operate/rc/rdi/setup) and configure credentials and connectivity.\n2. [Define your data pipeline](https://redis.io/docs/latest/operate/rc/rdi/define) by selecting which tables to sync and how to map them.\n3. [View and manage your pipeline](https://redis.io/docs/latest/operate/rc/rdi/view-edit) once it's running.\n\nSee the [RDI Cloud quick start](https://redis.io/docs/latest/operate/rc/rdi/quick-start) to get up and running quickly with a PostgreSQL source database.\n\n**Redis Enterprise:**\n\nRDI is also available for self-managed Redis Enterprise deployments. See the [Redis Data Integration documentation](https://redis.io/docs/latest/integrate/redis-data-integration) for full installation and configuration instructions."
    }
  ],
  "examples": []
}