Senior Data Engineer & People Lead
Zühlke Group
Porto, Portugal
How you’ll make impact
- Being a trusted advisor, guiding our customers towards a successful technical solution to their data challenges.
- Communicating the what, why and how of proposed solutions to technical and non-technical stakeholders.
- Mastering the big data world whilst developing, testing, and monitoring distributed data processing pipelines.
- Extrapolating versatile data sets and sources to produce high quality, reproducible datasets in a scalable and maintainable way.
- Collaborating with other data roles such as Architects, Software Engineers and Data Scientists with ease.
- Understanding the needs of many types of producers and consumers for our data services, ensuring our products meet their requirements.
- Delivering projects in an Agile way, building iteratively to produce value from data early and frequently.
- Keeping yourself technically sharp, being open to learning new concepts and technologies.
- Leading a team of passionate engineers, helping them grow and develop.
What is important to us
- You have a degree in computer science, software engineering or a comparable education (e.g. mathematics).
- Several years in software development or data engineering positions.
- Experience of designing, building and maintaining data products that meet the needs of data consumers.
- An understanding of common approaches to data analysis, machine learning and data visualisation so you can produce the right data for data consumers.
- Experience with a variety of approaches to data architectures (e.g. Data Lake, Data Mesh, Data Warehouse, streaming, batch processing).
- In addition to your knowledge of Python and SQL, you ideally have hands-on skills or a keen interest in such technologies as Hadoop, Apache Spark, Hive, Airflow, RDBMS, NoSQL, DevOps, Kubernetes, and Java or .NET.
- You have a good understanding of the possibilities of large public cloud environments and preferably have already used Amazon AWS, MS Azure or Google's GCP clouds.
- Hands-on experience with databases both relational and NoSQL.
- Familiarity with big data infrastructures and concepts for storing and processing large and/or heterogeneous data volumes.
- Practical knowledge of handling varied types of structured and unstructured data (text, tabular, graph, time-series, geospatial, image, etc.).
- Working knowledge of containerization and public and private Cloud environments.
- Knowledgeable about information security and data governance.
- Excellent and practical data programming skills with experience in different programming languages like Java or Python.
- You have experience delivering projects to deadlines, with an emphasis on quality, ideally in client facing contexts.
Apply Now
Don't forget to mention EuroTechJobs when applying.