Migration of a Front Office Reporting solution from Azure SQL Data Warehouse to Snowflake on Azure.

The Azure SQL Data Warehouse is completely replaced by Snowflake. The event-based deal import is redesigned to leverage the technological features of the target architecture. Currently the deal data is grouped into chunks and imported into the SQL DWH in bulk. With Snowflake it is possible to import more efficiently without grouping. With the new architecture the rules previously contained in stored procedures are implemented as Python scripts and executed using Azure Batch Services. The batch tasks are called via a REST API from Talend. This ensures an effective authorization control. The existing SQL stored procedures from the DWH are translated into Python and integrated Snowflake SQL. Features available in Snowflake, such as the management of time zones and time travel functionalities for reports comparing different versions, are used. As a further step, the Talend jobs will be adapted for data import and migrated to Talend 7.