Senior Data Engineer

Senior Data Engineer

Betty Technology

London, United Kingdom

Key Responsibilities:

• Collaborate with cross-functional teams, including Engineering, and business stakeholders, to define and understand data requirements;
• Develop and maintain scalable data pipelines for loading data from different sources into the DWH;
• Optimize and fine-tune existing data processes for improved performance;
• Collaborate with infrastructure teams to implement scalable and secure data platform;
• Create and maintain reports for regulatory requirements and internal business needs;
• Evaluate and implement new technologies, tools, and frameworks to enhance data processing and storage capabilities;
• Mentor junior colleagues, providing guidance in data engineering best practices.

Requirements:

• Bachelor's degree in Computer Science, Data Science, or a related field;
• 3+ years of experience in a data warehouse engineering or related role;
• Experience with cloud data warehousing technologies, such as Amazon Redshift, Snowflake, or Google BigQuery;
• Good programming skills in Python;
• Proficiency with SQL and data modelling;
• Experience with pipeline orchestration tools (e.g., Airflow, Dagster);
• Understanding of CI/CD principles and experience implementing automated deployment processes;
• Excellent analytical and problem-solving skills;
• Strong communication and teamwork skills;
• Fluency in English.

Nice to have:

• Experience with DBT;
• Experience with stream processing frameworks (e.g., Apache Kafka);
• Experience with containerization technologies (e.g., Docker, Kubernetes);
• Experience with data visualization tools (e.g., Looker, Tableau, Power BI).