🐘
Anecdote Docs
  • Getting started
  • Integrations
    • Gorgias
    • SurveyMonkey
    • Zendesk
    • SendBird
    • Freshdesk
    • Intercom
    • Kustomer
    • HubSpot
    • Typeform
    • Delighted
    • Android SDK
    • iOS SDK
  • Release Notes
  • On-Prem Setup
    • Getting started
    • Identifying the Need for On-Prem Setup
    • Strategy for Client-Side Data Collection and Processing
    • Architecture Overview
    • Why Airbyte and Its Technical Details
    • Custom Airbyte Destination Development and Specifications
    • Health Check Monitoring
  • Direct Data Injection EndPoint
    • Introduction
    • Getting Started
    • Authorization
    • Data Format
    • Error Handling
Powered by GitBook
On this page
  1. On-Prem Setup

Why Airbyte and Its Technical Details

PreviousArchitecture OverviewNextCustom Airbyte Destination Development and Specifications

Last updated 1 year ago

Selecting Airbyte was pivotal for its ease of deployment and in-memory processing capabilities, which align with our requirements for a secure and efficient data handling solution.

Airbyte Advantages: Perfect for quick deployment and in-memory data processing.

Understanding How Scraping Works: Airbyte's role in data integration is vital, streamlining the collection and consolidation of information.

  • Data Collection: Primarily driven by , constituting 90% of our data collection method. Airbyte processes HTTPS API requests, accumulating responses in a buffer before relaying them to the intended destination.

  • Source Code: Discover more at the .

Exclusive In-Memory Storing: Emphasizing the security and integrity of data during processing through Airbyte's in-memory data management approach.

  • Temporary Storage: Airbyte Sources store data in a buffer until collection completion, then transmit to the Destination. Post-PII removal, data is relayed to Anecdote’s infrastructure through the Injection End Point.

  • In-Memory Processing: Ensures data security and integrity during record processing

HTTP-API-based Sources
Airbyte GitHub Repository