Software Engineer II - AI / ML, AWS Neuron

Overview AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team for AWS Neuron. This role is responsible for development, enablement and performance tuning of a wide variety of ML model families, including state of art GEN-AI models and massive scale large language models like llama-4, Deepseeq and beyond, as well as stable diffusion, Vision Transformers and many more.

The ML Apps team works side by side with chip architects, compiler engineers and runtime engineers to create, build and optimize performance and accuracy of state-of-art models. The team automates the ML techniques to evaluate, detect, debug and resolve accuracy issues raising from migration of model to AI accelerators. The team develops AI tool chain for optimizing performance and accuracy of state-of-art models.

Responsibilities Lead efforts in building distributed inference support into PyTorch using XLA and the Neuron compiler and runtime stacks.

Demonstrate strong software development skills in C++ / Python and ML knowledge; identify optimization opportunities by performing comparative analysis and benchmarking with alternative solutions.

Develop and automate solutions to ensure the accuracy of AI accelerators while optimizing their performance.

Develop a set of deep AI toolchains to simplify and abstract the low-level AI accelerator modules.

Day in the Life / Work Philosophy Work / Life Balance : Our team values work-life balance and offers flexibility in working hours to help you find balance between personal and professional life.

Mentorship & Career Growth : We support new members with a mix of experience levels and tenure, fostering knowledge sharing and mentorship to help develop into a well-rounded professional.

About the Team Our team is dedicated to supporting new members with a focus on mentorship and thorough, constructive code reviews. We strive to help team members develop engineering expertise for taking on more complex tasks in the future.

Basic Qualifications 3+ years of programming using a modern language such as Java, C++, or C#, including object-oriented design experience

3+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems

3+ years of full software development life cycle experience, including coding standards, code reviews, source control, build processes, testing, and operations

Fundamentals of machine learning and deep learning models, their architecture, training and inference lifecycles, with work experience on optimizations for improving model execution

Preferred Qualifications Bachelor’s degree in computer science or equivalent

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country / region you’re applying in isn’t listed, please contact your Recruiting Partner.

Our compensation reflects the cost of labor across several US geographic markets. The base pay for this position ranges from $129,300 / year in our lowest geographic market up to $223,600 / year in our highest geographic market. Pay is based on a number of factors including market location and may vary depending on job-related knowledge, skills, and experience. Amazon is a total compensation company. Dependent on the position offered, equity, sign-on payments, and other forms of compensation may be provided as part of a total compensation package, in addition to a full range of medical, financial, and / or other benefits. For more information, please visit .

This position will remain posted until filled. Applicants should apply via our internal or external career site.

Posted : September 3, 2025 (Updated 18 days ago)

Posted : September 24, 2025 (Updated 3 days ago)

Posted : November 7, 2024 (Updated 9 days ago)

Share this job Important FAQs for current Government employees

Before proceeding, please review the following FAQs

is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

#J-18808-Ljbffr