Join to apply for the Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs role at Amazon Web Services (AWS)

2 weeks ago Be among the first 25 applicants

Description Do you want to be part of the AI revolution? At AWS, our vision is to make deep learning pervasive for everyday developers and democratize access to cutting-edge infrastructure. AWS Neuron is the SDK that optimizes the performance of complex ML models executed on AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads.

Role Overview This role is for a senior software engineer in the Compiler team for AWS Neuron. Responsibilities include building the next-generation Neuron compiler to transform ML models written in frameworks like PyTorch, TensorFlow, and JAX for deployment on AWS Inferentia and Trainium servers. You will solve complex compiler optimization problems to maximize performance across various ML models, including large language models, diffusion models, and vision transformers. A deep understanding of these models and how to optimize their implementation is essential. You will collaborate with cross-functional teams and contribute to pre-silicon design, product development, and open-source projects.

Qualifications

Experience in object-oriented languages like C++/Java.

Experience with compiler development or ML frameworks on accelerators (preferred but not required).

Experience with open-source compiler toolsets like LLVM/MLIR.

Knowledge of technologies like OpenXLA, StableHLO, MLIR is a plus.

Responsibilities

Design, implement, test, and maintain compiler software to improve performance and stability.

Collaborate with hardware architects, runtime engineers, and ML teams to optimize ML model deployment.

Engage with open-source communities and influence industry standards.

Develop features to enhance user experience for global developers.

About the Team The team values knowledge-sharing, mentorship, and career development, fostering an inclusive environment where diverse experiences are welcomed.

About AWS AWS is the leading cloud platform with a culture of innovation and inclusion. We support work-life balance, mentorship, and career growth.

Basic Qualifications

5+ years of professional software development experience.

Proficiency in at least one programming language.

Experience in system design, reliability, and scaling.

Experience with the software development lifecycle.

Leadership experience such as mentoring or team leading.

Preferred Qualifications

Master's or PhD in Computer Science or related field.

Experience with compiler design for accelerators.

Familiarity with ML frameworks like PyTorch, JAX, or tools like LLVM/MLIR.

Experience with build systems like Bazel or CMake.

This position remains open until filled. The role offers competitive compensation and benefits. Apply via our career site.

#J-18808-Ljbffr