Software Engineer, Trainium
Responsibilities
- Build and optimize OpenAI’s inference stack for AWS Trainium.
- Develop high-performance kernels for critical model operations and workloads.
- Extend compiler support to efficiently target Trainium hardware.
- Build systems to execute and optimize model forward passes on Trainium.
- Profile workloads and identify bottlenecks across kernels, compiler-generated code, runtimes, and model execution.
- Partner with inference and ML systems teams to bring new models and architectures to Trainium.
- Solve hardware/software performance problems end-to-end from investigation through production deployment.
Requirements
- 3+ years of relevant engineering experience, ideally in ML systems, compilers, kernels, runtimes, or performance engineering.
- Strong systems programming fundamentals and experience writing performance-critical software.
- Experience with GPU, TPU, Trainium, or other specialized accelerator architectures.
- Ability to reason about performance across hardware, kernels, compilers, and ML frameworks.
- Ability to own technically ambiguous problems end-to-end and learn new hardware and software domains.
- Experience with AWS Trainium or the AWS Neuron SDK is a bonus.
- Contributions to PyTorch or JAX, compiler infrastructure such as LLVM or MLIR, XLA, Triton, or specialized accelerator kernel development are bonuses.
Recommended Jobs
Principal Software Engineer - Pay Group Engineering
About Gusto At Gusto, we're on a mission to grow the small business economy. We handle the hard stuff — payroll, health insurance, 401(k)s, and HR — so owners can focus on their craft and their …
Accounts Payable Specialist POST NUMBER: 171357
Title: Accounts Payable Specialist Company: Construction/Engineering Industry Compensation: $25-30/hr (DOE) Key Responsibilities: Process and manage high-volume invoices monthly Match vendor invoices …
Senior PLM Business Analyst II
About The Role ABOUT ROCKET LAB Rocket Lab is an end-to-end space company delivering responsive launch services, complete spacecraft design and manufacturing, payloads, satellite components, and mor…
Senior Software Engineer - Python/Agentic AI
Get to Know Us: It's fun to work in a company where people truly believe in what they're doing! At BlackLine, we're committed to bringing passion and customer focus to the business of enterpri…
Principal Mechanical Engineer
Additional Location(s): N/A Diversity - Innovation - Caring - Global Collaboration - Winning Spirit - High Performance At Boston Scientific, we’ll give you the opportunity to harness all that’…
PHYSICIAN & SURGEON,CF (IM/FP)- Central California Women's Facility (CCWF)
Job Description and Duties Effective July 1, 2025, in accordance with the applicable Memorandum of Understanding, the Personal Leave Program 2025 (PLP 2025) was implemented. PLP 2025 requires each…
Correctional Supervising Cook, CF
Job Description and Duties The Correctional Supervising Cook ensure that all items needed for meals are present, and in proper amount, and supervise the preparation of meals ensuring that all food…
SEO Sales position
SEO Sales position Job Description: We are looking for sales associates to provide consultative sales for our search engine optimization/marketing services. Positions are currently available for Int…
Logistics Data Analyst
Logistics Data Analyst Position Description CGI is looking for a Logistics Data analyst to join the Camp Pendleton Marine Corps Platform Integration Center (MCPIC) team at Camp Pendleton, CA. T…