Staff ML Engineer - Infrastructure
New Today
Job Description
About Us
Chips are at the center of today's tech-driven world. But how we design them has not changed in decades, while their complexity and specialization have skyrocketed due to increasing performance demands from applications like AI. We want to change that.
Our team is small, technical, and fast-moving. We’ve built and shipped at the intersection of AI, EDA, and systems software, with deep roots at companies like Qualcomm, Nvidia, Google, Meta, and the Allen Institute for AI. We’re backed by top investors including Khosla Ventures, Cerberus, and Clear Ventures, and already deployed with 10+ innovative customers—from Fortune 100s to cutting-edge AI silicon startups.
About This Role
This role offers a unique opportunity to be part of the founding team at ChipStack, where we are reinventing how modern silicon chips are designed. You will work alongside highly experienced chip designers who have built complex chips, ML scientists who have trained LLMs at scale, and top-notch infrastructure and software engineers. You will get to leverage your experience building ML and data infrastructure and apply it to some of the hardest problems in chip design.
About You
You want to be at a startup because you love to be at the center of all the dynamism that a startup offers.
You are willing to put in the hours and go the extra mile to ensure every customer has an exceptional experience.
You are self-motivated with a sense of urgency and can operate independently without much guidance.
You are not afraid of difficult problems and enjoy venturing into areas you have not explored before.
This Role
We’re looking for a strong, experienced ML Infrastructure Engineer to join our founding team. We are seeking someone with experience designing and scaling ML infrastructure and training pipelines. You’ll be responsible for building the core infrastructure that enables training, fine-tuning, evaluation, and deployment of LLMs across cloud and on-premise environments. Your work will directly impact product capabilities and speed of iteration.
What's needed
5+ years of experience in ML infrastructure or adjacent roles
Deep expertise in Python and experience with training frameworks like PyTorch or TensorFlow
Strong systems engineering skills and experience with distributed training, data pipelines, and performance optimization
Experience deploying ML models to production (REST APIs, batch jobs, streaming pipelines)
Proficiency with cloud platforms (e.g., GCP, AWS) and containerized systems (Docker, Kubernetes)
Experience managing GPU/TPU workloads efficiently
Good communication skills and the ability to work directly with engineers and customers
Prior experience training or fine-tuning LLMs
Experience setting up observability, monitoring, and evaluation pipelines for ML models
What's good to have
Exposure to chip design fundamentals (via coursework or elsewhere)
Experience at an early-stage startup
Our Culture
Challenge status quo: We are innovators who can challenge the status quo and push forward our vision of the world.
Strong opinions, loosely held: We are low on ego, but high on collaboration. We are okay to be wrong and are always open to learning.
Ship fast, ship quality: We ruthlessly prioritize what matters. We build a few things, but at lightning speed with high quality.
Proud of our craft: Attention to detail is in our DNA. We take pride in what we build and ensure they exceed the high standards of the semiconductor industry.
- Location:
- San Jose
- Category:
- Engineering
We found some similar jobs based on your search
-
New Today
Staff ML Engineer - Infrastructure
-
San Jose
- Engineering
Job Description Job Description About Us Chips are at the center of today's tech-driven world. But how we design them has not changed in decades, while their complexity and specialization have skyrocketed due to increasing performance demands from...
More Details -
-
20 Days Old
Principal Member of Technical Staff - AI/ML Infrastructure Engineer
-
Santa Clara, CA, United States
- IT & Technology
As an AI/ML Infrastructure Engineer on the GPU Strategic Customers Engineering team, you will play a critical role in designing, implementing, and maintaining the infrastructure that supports our AI and machine learning initiatives. You will work clo...
More Details -