Oracle Cloud Infrastructure’s Incubations team is looking for a Senior Machine Learning Engineer with strong ML experience to join a high-impact, fast-moving team building the next generation of AI-powered services at scale.
In this role, you’ll work across the stack—from Kubernetes infrastructure to cutting-edge ML frameworks like vLLM , LangChain , PyTorch and popular open-source models —to prototype and deliver agentic AI applications and ML infrastructure as a service. You’ll operate at the intersection of infrastructure, research, and product innovation, helping to define and deliver ambitious new product initiatives.
We’re seeking a self-starter and technical leader—someone who thrives in ambiguity, moves fast, and brings both software engineering rigor and machine learning intuition to the table.
Key Responsibilities
Design, build, and deploy ML systems and agentic AI prototypes on OCI using popular open-source frameworks.
Deploy and manage native GPU infrastructure for ML serving, fine-tuning, and inference pipelines using Terraform and Helm.
Develop scalable backend services using Python to expose ML capabilities as APIs.
Benchmark, evaluate, and optimize model performance, GPU hardware performance, and ML software performance.
Lead ideation and experimentation on early-stage AI initiatives and bring new technical directions to life within OCI.
Collaborate across research, product, and OCI compute platform teams to drive integration and productization of ML capabilities.
Contribute to internal tooling, observability, and developer experience improvements for ML infra.
Preferred Qualifications
5+ years of experience in software engineering or ML engineering roles
Experience working with containers, Kubernetes , including deploying ML workloads
Proficiency in Python & PyTorch/JAX or other ML software.
Experience writing infrastructure-as-code using Terraform and managing cloud-native services
Familiarity with model evaluation techniques and tools for benchmarking and profiling
Proven track record of owning complex technical projects from concept to delivery
Comfortable in a fast-paced, ambiguity-rich environment where innovation is expected
Cloud services experience working with OCI, AWS, GCP, or Azure
Nice to Have
Experience fine-tuning models using LoRA / PEFT
Prior work with GPU-optimized serving on OCI, AWS, GCP, or Azure
Background in distributed inference or training on multi-GPU / multi-node environments – High Performance Computing setup.
Experience contributing to or maintaining OSS ML libraries
Disclaimer:
Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.
Range and benefit information provided in this posting are specific to the stated locations only
US: Hiring Range in USD from: $96,800 to $223,400 per annum. May be eligible for bonus and equity.
Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.
Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.
Oracle US offers a comprehensive benefits package which includes the following:
1. Medical, dental, and vision insurance, including expert medical opinion
2. Short term disability and long term disability
3. Life insurance and AD&D
4. Supplemental life insurance (Employee/Spouse/Child)
5. Health care and dependent care Flexible Spending Accounts
6. Pre-tax commuter and parking benefits
7. 401(k) Savings and Investment Plan with company match
8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.
9. 11 paid holidays
10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.
11. Paid parental leave
12. Adoption assistance
13. Employee Stock Purchase Plan
14. Financial planning and group legal
15. Voluntary benefits including auto, homeowner and pet insurance
The role will generally accept applications for at least three calendar days from the posting date or as long as the job remains posted. Career Level - IC4