Development of a streaming application for real-time reporting of event data

The event data is transferred directly from the source system with the Change Data Capture (CDC) tool HVR into the Kafka cluster of the Confluent Platform. KSQL operations process (transform, filter and aggregate) them in real time to then calculate KPIs for a real-time dashboard. The dashboard is based on a SPRING boot client-server application that consumes the KPIs and event data of the Kafka cluster in real-time and visualizes them in the web browser. The event data, enriched with geocoordinates, is displayed on a map as a heat map with the aim of highlighting areas with a high number of events. By using the Javascript libraries Leaflet.js and d3.js a modern appearance is realized. The use of websockets for the communication between client and server ensures the real-time character of the dashboard application.