Development of an extension of the Oracle Data Integrator using the OpenTool API
Project duration: 4 months
Brief description
As part of the customer's Business Intelligence project, an extension of the ETL tool Oracle Data Integrator is planned, which enables parallel queries to be made to any REST interfaces or services in order to minimise runtime.
Supplement
Version 12c of the ETL/ELT tool Oracle Data Integrator (ODI) offers by default only one module that allows sequential (single-threaded) queries at REST interfaces. The generation of sequential requests to a REST service leads to unacceptable runtimes within the processing chain of ETL or ELT processes with mass data processing of several million requests. The development of the module for parallel (multi-threaded) processing of requests to any REST interface is done using Java 1.8 and the OpenTool API of ODI 12c. Different variants are required which provide both a relational database system and a file system as source (request) and target (response).