Own the technical chain that turns field events into trustworthy INSIGHTS data products: acquisition, storage, transformation, executable metric logic, technical validation and delivery to pilot sites.
The role is accountable for making the numbers reproducible, traceable and operable. It contributes to architecture decisions with the INSIGHTS architect and works with the KPI Governance & Adoption role to keep technical evidence aligned with intended use.
What you will do
Build reliable ingestion and processing pipelines from operational databases, APIs and event streams generated by warehouse software and robotic equipment.
Design for event time, duplicates, late or missing events, idempotency, reconciliation and replay; preserve the raw evidence needed to audit or recompute a result.
Model and transform data into versioned, tested datasets and implement the calculation logic behind INSIGHTS metrics.
Make data quality, completeness, pipeline health and known limits observable rather than implicit.
Package and deploy the data chain on on-premise infrastructure, and contribute to upgrades, recovery, security, configuration and cloud connectivity.
Work with the architect on technology choices and interfaces, using focused experiments to resolve uncertainty and simplify the system.
Investigate discrepancies with domain experts and support the first customer pilots through to working, explainable results.
Qualifications
Around 3-6 years of hands-on experience in data engineering, data-platform engineering or backend software engineering with substantial data responsibilities.
Strong Python and SQL skills, sound data modelling, and disciplined use of Git, tests and CI/CD.
Practical experience with event-driven or distributed data systems, and with operating pipelines beyond the development environment.
Comfortable with Linux, containers, logs, networking and the unglamorous work of diagnosing why data did not arrive or cannot be trusted.
Able to understand a physical process, learn an unfamiliar domain and turn ambiguous operational behaviour into explicit engineering rules.
Curious, inventive and pragmatic: willing to challenge a design, run an experiment, learn a new technology and finish the job.
Fluent professional English.
Experience with industrial, IoT, edge or on-premise systems is valuable, but not mandatory if the underlying engineering experience is strong.
Don't forget to mention EuroTechJobs when applying.