Senior Staff AI Engineer – LLM inference optimization

New Today

Senior Staff AI Engineer – LLM inference optimizationSenior Staff AI Engineer – LLM inference optimization 1 day ago Be among the first 25 applicants Direct message the job poster from Yoh, A Day & Zimmermann Company Sr. Business Operations, Yoh Silicon Valley (Formerly ERG, Inc.) Senior Staff AI Engineer – LLM inference optimization
Apply (by clicking the relevant button) after checking through all the related job information below.
Roles and Responsibilities:
Design and architect technical solutions to deliver foundational AIOS capabilities within SkyOS across ECU domains in electric vehicles (EVs). Lead the development of proof-of-concept projects to evaluate architectural designs for functionality, performance, security, and reliability. Collaborate closely with engineering teams to understand real-world development constraints and ensure high-quality implementation, validation, and integration of AIOS designs. Define the technical roadmap for the evolution of AIOS solutions. Develop and communicate clear requirements to guide the development team. Continuously monitor industry trends and analyze competitors’ technical approaches.
Required Qualifications: 5+ years of experience in software design and development focused on AI model inference optimization, and deployment. Strong knowledge of Large Language Models (LLMs) with expertise in optimizing inference on resource-constrained edge devices. Vision-Language Models (VLMs) are a plus. Hands-on experience with cutting-edge AI models and frameworks. Solid background in GPU/NPU architectures and AI training frameworks such as PyTorch, TensorFlow, or similar. 7+ years of experience building complex software systems. Proficiency in C/C++ and Python programming languages.
Preferred Qualifications: Expertise in optimizing AI models for inference on edge devices. Experience with performance tuning and inference optimization for deep learning models across various hardware platforms. Deep understanding of computer architectures, including CPU, MPU, GPU, and NPU technologies. Solid foundation in embedded and mobile operating systems. Familiarity with microkernel architectures, Linux kernel development, hypervisors, middleware, and application frameworks.
Estimated Min Rate : $200,000.00 Estimated Max Rate : $300,000.00
What’s In It for You? We welcome you to be a part of the largest and legendary global staffing companies to meet your career aspirations. Yoh’s network of client companies has been employing professionals like you for over 65 years in the U.S., UK and Canada. Join Yoh’s extensive talent community that will provide you with access to Yoh’s vast network of opportunities and gain access to this exclusive opportunity available to you. Benefit eligibility is in accordance with applicable laws and client requirements. Benefits include:
Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week) Health Savings Account (HSA) (for employees working 20+ hours per week) Life & Disability Insurance (for employees working 20+ hours per week) MetLife Voluntary Benefits Employee Assistance Program (EAP) 401K Retirement Savings Plan Direct Deposit & weekly epayroll Referral Bonus Programs Certification and training opportunities
Note: Any pay ranges displayed are estimations. Actual pay is determined by an applicant's experience, technical expertise, and other qualifications as listed in the job description. All qualified applicants are welcome to apply.
Yoh, a Day & Zimmermann company, is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Visit https://www.yoh.com/applicants-with-disabilities to contact us if you are an individual with a disability and require accommodation in the application process.
For California applicants, qualified applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. All of the material job duties described in this posting are job duties for which a criminal history may have a direct, adverse, and negative relationship potentially resulting in the withdrawal of a conditional offer of employment.Seniority level Seniority levelNot Applicable Employment type Employment typeFull-time Job function IndustriesComputer Hardware Manufacturing and Software Development Referrals increase your chances of interviewing at Yoh, A Day & Zimmermann Company by 2x Get notified about new Artificial Intelligence Engineer jobs in San Jose, CA . Software Engineer, AI Platform - New Grad Mountain View, CA $145,000.00-$170,000.00 2 weeks ago AI/ML Engineer (Multiple roles and seniority levels) San Jose, CA $137,500.00-$236,500.00 1 day ago San Jose, CA $120,700.00-$228,600.00 3 days ago San Jose, CA $120,700.00-$228,600.00 3 days ago San Jose, CA $120,700.00-$228,600.00 3 days ago Sunnyvale, CA $167,000.00-$185,500.00 2 weeks ago Sunnyvale, CA $167,000.00-$185,500.00 1 week ago San Jose, CA $137,500.00-$236,500.00 4 weeks ago Santa Clara, CA $137,300.00-$212,900.00 4 days ago San Jose, CA $169,500.00-$291,500.00 1 day ago Sunnyvale, CA $167,000.00-$185,500.00 1 month ago San Jose, CA $120,000.00-$240,000.00 4 months ago San Jose, CA $120,700.00-$228,600.00 3 days ago Palo Alto, CA $2,000.00-$2,500.00 6 hours ago San Jose, CA $120,700.00-$228,600.00 1 day ago San Jose, CA $120,700.00-$301,200.00 3 days ago San Jose, CA $142,700.00-$257,600.00 3 days ago San Jose, CA $102,400.00-$196,300.00 3 days ago Mountain View, CA $152,000.00-$228,000.00 1 day ago San Jose, CA $176,600.00-$225,900.00 3 weeks ago San Jose, CA $130,000.00-$182,000.00 11 months ago Mountain View, CA $141,000.00-$202,000.00 2 days ago San Jose, CA $118,657.00-$177,000.00 1 week ago Palo Alto, CA $180,000.00-$440,000.00 20 hours ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Location:
San Jose, CA
Salary:
$200
Category:
Engineering

We found some similar jobs based on your search