Implementation of data platform for transformation and data exchange
Brief description
A data platform based on 'Apache Kafka' was created for the customer. Routing and transformation rules can be set up by specialists via an editorial system.
Supplement
For the flexible transformation of internal data structures into standardized (Bipro, GDV, ..) or individually agreed data exchange formats, a transformation and routing application similar to a lambda architecture was created. The application is based on microservices that run on a container runtime such as Kubernetes and communicate via apache kafka.
Subject description
A clear separation of responsibilities has been made for the application – the platform as such should be agnostic with regard to transformations – the transformation rules themselves are maintained via the editorial system and applied by the platform at runtime. This also made it possible to achieve a separation of responsibilities in organisational terms.