Machine Learning Engineer, ML Runtime & Optimization, Mid-Level Join to apply for the Machine Learning Engineer, ML Runtime & Optimization, Mid-Level role at Jobright.ai Machine Learning Engineer, ML Runtime & Optimization, Mid-Level 2 days ago Be among the first 25 applicants Join to apply for the Machine Learning Engineer, ML Runtime & Optimization, Mid-Level role at Jobright.ai Pony.ai develops autonomous driving technology for vehicles that operates using artificial intelligence and machine learning. As a Machine Learning Engineer in ML Runtime & Optimization, you will be developing technologies to accelerate the training and inferences of the AI models in autonomous driving systems. Responsibilities: • Identifying key applications for current and future autonomous driving problems and performing in-depth analysis and optimization to ensure the best possible performance on current and next-generation compute architectures. • Collaborating closely with diverse groups in Pony.ai including both hardware and software to optimize and craft core parallel algorithms as well as to influence the next-generation compute platform architecture design and software infrastructure. • Apply model optimization and efficient deep learning techniques to models and optimized ML operator libraries. • Work across the entire ML framework/compiler stack (e.g.Torch, CUDA and TensorRT), and system-efficient deep learning models. Qualifications: Required: • BS/MS or Ph.D in computer science, electrical engineering or a related discipline. • Strong programming skills in C/C++ or Python. • Experience on model optimization, quantization or other efficient deep learning techniques. • Good understanding of hardware performance, regarding CPU or GPU execution model, threads, registers, cache, cost/performance trade-off, etc. • Experience with profiling, benchmarking and validating performance for complex computing architectures. • Experience in optimizing the utilization of compute resources, identifying and resolving compute and data flow bottlenecks. • Strong communication skills and ability to work cross-functionally between software and hardware teams. Preferred: • Experience with parallel programming, ideally CUDA, OpenCL or OpenACC. • Experience in computer vision, machine learning and deep learning. • Strong knowledge of software design, programming techniques and algorithms. • Good knowledge of common deep learning frameworks and libraries. • Deep knowledge on system performance, GPU optimization or ML compiler. Company: Pony.ai develops autonomous driving technology for vehicles that operates using artificial intelligence and machine learning. Founded in 2016, the company is headquartered in Fremont, California, USA, with a team of 1001-5000 employees. The company is currently Public Company. Pony.ai has a track record of offering H1B sponsorships. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Industries Software Development Referrals increase your chances of interviewing at Jobright.ai by 2x Inferred from the description for this job Medical insurance Vision insurance 401(k) Get notified when a new job is posted. Sign in to set job alerts for “Machine Learning Engineer” roles. AI/ML Engineer (Multiple roles and seniority levels) San Jose, CA $137,500.00-$236,500.00 5 days ago San Jose, CA $120,700.00-$228,600.00 1 week ago Milpitas, CA $152,500.00-$219,200.00 2 weeks ago San Jose, CA $120,700.00-$228,600.00 1 week ago New Grads 2025 - Software Engineer - Computer Vision/Deep Learning San Jose, CA $120,000.00-$165,000.00 9 months ago Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.00-$170,000.00 4 days ago New Grads 2025 - Software Engineer, Algorithm San Jose, CA $120,000.00-$165,000.00 10 months ago Machine Learning Engineer (I, II, or Sr.) San Jose, CA $120,700.00-$228,600.00 5 days ago Machine Learning Engineer, Early Stage Project Mountain View, CA $136,000.00-$185,000.00 1 week ago San Jose, CA $137,500.00-$236,500.00 1 month ago Sunnyvale, CA $158,200.00-$185,000.00 3 weeks ago Machine Learning Engineer (I, II, or Sr.) Data Scientist II – Experimentation & Measurement San Mateo, CA $153,300.00-$229,900.00 1 week ago San Jose, CA $120,700.00-$228,600.00 1 week ago San Jose, CA $118,657.00-$187,200.00 1 week ago Sunnyvale, CA $167,000.00-$185,500.00 1 month ago San Jose, CA $120,000.00-$240,000.00 4 months ago San Jose, CA $169,500.00-$291,500.00 5 days ago Sunnyvale, CA $167,000.00-$185,500.00 3 weeks ago San Jose, CA $120,700.00-$301,200.00 1 week ago New Grads 2025 - General Software Engineer San Jose, CA $120,000.00-$165,000.00 6 months ago San Jose, CA $130,000.00-$182,000.00 11 months ago San Jose, CA $142,700.00-$257,600.00 1 week ago Redwood City, CA $167,200.00-$250,800.00 1 week ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr