Associate Data Engineer

Associate Data Engineer

adidas

Porto, Portugal

The purpose of this role is to explore various internal and external data sources, integrate those data sources and prepare data for the consumption in a lakehouse. This will happen in the context of the creation of an integrated analytical data model connecting the dots between data sources like Kafka, SAP, etc. You will have e2e ownership (with senior supervision) from the acquisition of the data through defined interfaces until integrated exposure in the analytical data model.

Are you looking for...?

• Being part of our team that delivers unseen Insights generated from Data;
• Creating the data backbone powering Analytics and AI solutions that put decision making on the next level;
• Working in the latest technologies such as Spark, Delta Lake, Airflow, Python, etc.;
• Use of Databricks to work in a Lakehouse concept.

What are we looking for?

• A developer able to create state of the art data applications using Python and SQL;
• Understanding of Spark internals;
• Knowledge in cloud platforms, data modeling, both batch and streaming workloads, and databases;
• Minimum of 3 years of hands-on data engineering experience;
• Experienced in software engineering best practices (design patterns, test-driven development and clean code);
• Experienced in Agile/Scrum methodologies and collaboration with cross-functional teams (preferential);
• Knowledge in data platforms such as Databricks (preferential);
• Fluency in English (mandatory);
• Experience in computer vision, linear algebra, computer graphics, signal processing or geometry processing (preferential);
• Experience in handling/transforming/managing of following data (image/video data, time-dependent data, 3D data) for analytics use cases (preferential).