High-quality software and complex ML models require dynamic and sophisticated automation to evaluate them. The ML Systems Evaluation Engineering (ML SEE) team, within the AI/ML org at Apple, is looking for an outstanding Software Engineer to evaluate our systems and deliver the best experience for our customers across the world. This exciting role will bridge knowledge, and experience from software engineering to the ML world, combining the best of both to build robust, extensible and efficient systems to evaluate ML products at scale.
In this role, you will have the opportunity to craft the vision of end-to-end automated systems evaluation methodology, for all Siri supported languages. You will have the opportunity to influence the design of Apple ML products, and ensure it is flexible to evaluate them at scale through high levels of automation. You will operate in a highly cross-functional environment to keep pushing the boundaries of existing tests automation and ML evaluation.
If you are committed in delivering an outstanding customer experience, and are a skilled and passionate software engineer, this is a great opportunity to apply your expertise to an entirely new problem space.
You will be leading a team of software engineers to design and develop solutions to perform automated end to end functional evaluation for our Siri languages. This includes design of automation frameworks and methodologies for simulation and evaluation of user experiences for ML based products at scale.
You will be a technology evangelist ensuring best practices for software development are followed in the team.
The role spans from AIML product qualification, implementation and iteration on systems, frameworks and evaluation methodologies, defining and tracking user impact and user success metrics. Equally, this role will participate in the AIML product specific roadmap decisions, contributing insights and recommendations derived from the in-depth understanding of the current success metrics of AIML products.
If this sounds like a role that could be of interest, we would love to hear from you!