Architecture conception and implementation of a BI platform in the sense of a data lake
Project duration: 1 year, 3 months
Brief description
The project comprises the conception and implementation of an architecture with the goal of creating a BI platform based on a data lake. Different technologies have to be integrated into the overall architecture in a suitable way so that customer requirements such as real-time data connection, integration of semi-structured data, long-term data archiving and high-performance detailed data reporting on mass data are taken into account.
Supplement
A core task is the integration of the different components into the system architecture of an Enterprise Data Warehouse (EDWH): starting with the components for the connection of source systems such as HVR, Oracle Data Integrator (ODI) or Teradata Listener via the components for data management such as Teradata and Hadoop to the access components Teradata QueryGrid, SAP BusinessObjects Web Intelligence and Tableau.
Subject description
A layer model for delimiting different data areas serves to encapsulate various core tasks such as data versioning of source systems, data integration into logical business objects and reporting in compliance with data privacy. Also anchored in the layer model is the separation into isolated environments for development, integration and production as a central requirement in the sense of continuous integration. Finally, standards and conventions are to be defined that enable continuous further development of the customer's EDWH.