Join to apply for the Machine Learning Engineer - Perception role at ZooxJoin to apply for the Machine Learning Engineer - Perception role at ZooxThe Perception team at Zoox is fundamental to our autonomous vehicle technology, creating the understanding of the world for our self-driving robots. We enable safe and efficient navigation in complex environments through sophisticated detection, classification, and tracking systems.As a member of the Detection, you'll be responsible for helping build sensor fusion models for detecting agents around the robot. You will work on building the vision backbone of the detector by designing sensor fusion models for Zoox's sensor data. You will work on incorporating SOTA language alignment strategies into the per-sensor modality backbones and help Zoox advance faster into new geofences by making the models more generalizable and adaptable to new circumstances.In This Role, You WillTrain and upgrade current image backbone by performing various studies into incorporating SOTA approaches to be multi-frame, even higher resolution and using large foundational, language-aligned feature encoderDeploy temporal image backbone into on-vehicle inference architecture and optimize runtime compute resource;Incorporate temporal information into the the existing Zoox’s multi-sensor (Vision, Lidar and Radar) early fusion system to predict object velocity and scene flowDevelop effective metrics and evaluating algorithm performance with these metrics to demonstrate improvement.Collaborate with teams such as ML Optimization, Data Labeling, V&V/Metrics and Planner/Prediction to ensure project is successful for Zoox releasesQualificationsMaster's degree or PhD in computer science or related fieldExperience with Vision Language Model or multi-modal 3D foundation model.Experience with Python and/or C++Experience with model deployment with TensorRTProficient in PyTorch model design, implementation, training and evaluation.Bonus QualificationsGPU/CUDA programming experienceExperience with customized TRT plugin developmentExperience working with LiDAR, Camera and Radar data$172,000 - $235,000 a yearBase Salary RangeThere are three major components to compensation for this position: salary, Amazon Restricted Stock Units (RSUs), and Zoox Stock Appreciation Rights. A sign-on bonus may be offered as part of the compensation package. The listed range applies only to the base salary. Compensation will vary based on geographic location and level. Leveling, as well as positioning within a level, is determined by a range of factors, including, but not limited to, a candidate's relevant years of experience, domain knowledge, and interview performance. The salary range listed in this posting is representative of the range of levels Zoox is considering for this position.Zoox also offers a comprehensive package of benefits, including paid time off (e.g. sick leave, vacation, bereavement), unpaid time off, Zoox Stock Appreciation Rights, Amazon RSUs, health insurance, long-term care insurance, long-term and short-term disability insurance, and life insurance.About ZooxZoox is developing the first ground-up, fully autonomous vehicle fleet and the supporting ecosystem required to bring this technology to market. Sitting at the intersection of robotics, machine learning, and design, Zoox aims to provide the next generation of mobility-as-a-service in urban environments. We’re looking for top talent that shares our passion and wants to be part of a fast-moving and highly execution-oriented team.Follow us on LinkedInAccommodationsIf you need an accommodation to participate in the application or interview process please reach out to accommodations@zoox.com or your assigned recruiter.A Final NoteYou do not need to match every listed expectation to apply for this position. Here at Zoox, we know that diverse perspectives foster the innovation we need to be successful, and we are committed to building a team that encompasses a variety of backgrounds, experiences, and skills.Seniority levelSeniority levelNot ApplicableEmployment typeEmployment typeFull-timeJob functionJob functionEngineering and Information TechnologyIndustriesAutomotiveReferrals increase your chances of interviewing at Zoox by 2xSign in to set job alerts for “Machine Learning Engineer” roles.Boston, MA $150,000.00-$220,000.00 3 weeks agoBoston, MA $160,000.00-$280,000.00 1 year agoWaltham, MA $142,700.00-$257,600.00 1 week agoMachine Learning Engineer, PersonalizationBoston, MA $136,878.00-$195,540.00 5 days agoBoston, MA $119,000.00-$169,000.00 1 month agoBoston, MA $130,000.00-$180,000.00 6 months agoQuincy, MA $93,840.00-$140,760.00 1 week agoResearch Scientist, Machine Learning / AICambridge, MA $120,000.00-$180,000.00 5 months agoCambridge, MA $120,000.00-$140,000.00 1 week agoWaltham, MA $98,560.00-$138,600.00 3 days agoCambridge, MA $140,000.00-$150,000.00 5 days agoCambridge, MA $120,000.00-$140,000.00 11 hours agoBoston, MA $125,000.00-$178,000.00 1 day agoCambridge, MA $120,000.00-$140,000.00 3 days agoWe’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr