Ingestion Pattern
The following are ingestion pattern principals for the
integration of data sources into Maestro Data Lake:
-
Oracle Golden Gate replica – This pattern is
recommended when Source application has a replica database
or Mirror database using OGG replication process
-
Relational Database integration – This pattern is
recommended when source application provides access true
source database or backup databases’ instead of OGG
replica
-
FTP Drop Zone – This pattern is recommended when
source application mirror or backup databases are not
available and data dump is available in flat files in FTP
drop zones
-
MQ Ingestion – This pattern is recommended when MQ
feed is available for data consumers
-
API Ingestion – This pattern is recommended where
APIs and end points are available for consumers
-
Cloud storage Ingestion – This pattern is
recommended when source application data can be made
available on cloud storage. As part of solution design
phase, feasibility options of various integration patterns
are reviewed with Source Application’s Solution Architect
and accordingly the integration solution is finalized.