Data /

Data Ingestion

Ingestion Pattern

The following are ingestion pattern principals for the integration of data sources into Maestro Data Lake:

  • Oracle Golden Gate replica – This pattern is recommended when Source application has a replica database or Mirror database using OGG replication process
  • Relational Database integration – This pattern is recommended when source application provides access true source database or backup databases’ instead of OGG replica
  • FTP Drop Zone – This pattern is recommended when source application mirror or backup databases are not available and data dump is available in flat files in FTP drop zones
  • MQ Ingestion – This pattern is recommended when MQ feed is available for data consumers
  • API Ingestion – This pattern is recommended where APIs and end points are available for consumers
  • Cloud storage Ingestion – This pattern is recommended when source application data can be made available on cloud storage. As part of solution design phase, feasibility options of various integration patterns are reviewed with Source Application’s Solution Architect and accordingly the integration solution is finalized.

Layers of Data Lake


Who is Maestro Data Lab for?