Responsible for ingestion of data sources and feature engineering to support creation of modelling data layers, integrate data into models/workflows;
Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies;
Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Fabric;
Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data;
Improve the scalability, efficiency, and cost-effectiveness of data pipelines;
Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data.
Qualifications
Good Python skills;
Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling;
Strong experience with Relational and ideally NoSQL databases;
Strong understanding of ETL/ELT processes;
Exposure to data monitoring and observability tools.
Don't forget to mention EuroTechJobs when applying.