Join our dynamic team at Amazon as a Senior Software Engineer - Generative AI Inference Lead, where you will play a critical role in advancing the company's Generative AI technology to enhance customer experiences and business outcomes. Key Responsibilities: Design, develop, test, and deploy high-performance inference capabilities focusing on multi-modality and state-of-the-art model architectures. Collaborate with a talented team of machine learning engineers and scientists to shape our overall strategy and define the team's roadmap. Drive system architecture decisions, promote best practices, and mentor junior engineers to foster professional growth. Stay updated with emerging techniques by reading research papers and consulting with scientists, integrating new ideas into our projects. Experiment with new algorithms, benchmark latency and accuracy, and implement production-grade solutions swiftly. Support production systems with a strong commitment to operational excellence, constantly seeking ways to innovate and minimize operational load. About the Team: Our mission is to develop fast, accurate, and cost-efficient large language model inference solutions that deliver significant value to Amazon businesses and customers. Qualifications: Basic Qualifications: 5+ years of professional software development experience. 5+ years of experience in at least one programming language. 5+ years of experience leading design or architecture of new and existing systems. Experience mentoring or leading an engineering team. Knowledge of software performance optimization or experience with Machine Learning and Deep Learning. Preferred Qualifications: Bachelor's degree in computer science or a related field. Experience with Large Language Model inference and GPU programming. Proficiency in Python, PyTorch, and C++ with a focus on performance optimization. At Amazon, we celebrate diversity and are committed to creating an inclusive environment for all employees. We offer competitive compensation that varies by location, with a base pay that ranges from $151,300 to $261,500, based on multiple factors. We also provide a comprehensive total compensation package, including various benefits. This position is located at our office, and will remain posted until filled. If you are passionate about leveraging AI technology to make a difference, we encourage you to apply and be part of a forward-thinking team at Amazon.