Data Engineer (BR-11039)
Key Responsibilities
Data Engineering tasks
o Develop new functionalities for the data pipeline (including improving data quality functions, harmonization of data over multiple nationalities and calculating out of it new KPIs for the Dashboard usage)
o Maintain and improve existing Global Reporting functionalities
Overall
o Understand and explain advantages and disadvantages of the proposed solutions to internal and external stakeholders
o Participate in Scrum ceremonies e.g. daily standup, Sprint review
o Resolve incidents and change requests
o Write technical documentation and apply best practices
Key requirements /skills /experience
The Global Reporting service is a reporting service based on Azure components (mainly Azure Data Factory). Data is collected from individual country based databases, processed in our pipeline and aggregated to final KPIs. Those are used for analysis and underwriting purposes of the group.
A successful candidate is expected to provide the following knowledge:
• Experience building and optimizing “big data” pipelines and architectures
• Hands-on experience with Azure Cloud services (especially Azure Data Factory)
• Deep knowledge in writing complex queries for RDBMS Systems (PostgreSQL)
• Solid Spark knowledge
• Experience with Databricks and Synapse
• Hands on experience with Python
• General understanding of Networking and IT Security Principles
• Hands-on experience with SQL database design is a plus
• Practical experience with Linux, shell scripting and GIT ( and other DevOps related tools) is a plus
• Experience with Data Governance Frameworks (e.g. Informatica) and principles is a plus
• Hands-on experience with PowerBI implementation is a plus
Other skills:
• Bachelor (BSc), Master (MSc) or equivalent experience in a technical field (for example, Computer Science, Engineering)
• Fluent English (written and spoken) is a must, German language is a plus
• Willingness and ability to learn new technologies and tools
• Team-player open to work in an agile and flexible environment
What our partner offers
• Competitive salary package according to candidate’s knowledge and competences
• Annual financial bonus – based on individual targets
• Wide package of certified trainings
• Possibility to develop existing and new skills
• Support of work-life balance