Massachusetts Green Jobs

MassHire JobQuest Logo

Job Information

Oracle Principal Machine Learning Engineer (OCI/GEN AI) in Boston, Massachusetts

Job Description

At Oracle Cloud Infrastructure (OCI), we build the future of the cloud for Enterprises as a diverse team of fellow creators and inventors. We act with the speed and attitude of a start-up, with the scale and customer-focus of the leading enterprise software company in the world.

Oracle Generative AI Service is an exciting team in Oracle Cloud Infrastructure. We are delivering innovative services at the intersection of artificial intelligence and cloud infrastructure. In Generative AI Service team, you will build and operate massive-scale cloud services leveraging state of art machine learning technologies. We are committed to providing the best in cloud products to meet the needs of our customers who are tackling some of the world’s most challenging problems.

You will be part of a team of smart, hands-on engineers with the expertise and passion to solve difficult problems in distributed highly available services and virtualized infrastructure. At every level, our engineers have a significant technical and business impact by designing and building innovative new systems to power our customer’s business critical applications.

As a Principal Machine Learning Engineer in Generative AI Service team, you will be leading the effort of building distributed, scalable, high-performance AI model training and serving systems in partnership with our applied scientists and software engineers. You will dive deep into model structure to optimize model performance and scalability. You will build state of art systems with cutting-edge technologies in this fast evolving area. you will play a key role in shaping the future of Generative AI at Oracle, with an emphasis on Large Language Models (LLMs) and Multi-modality Models. Your contributions will be pivotal in delivering our new Generative AI-powered services for large scale enterprise customers.



  • Collaborate with product managers to translate business and product requirements into AI projects.

  • Collaborate with fellow technical leaders to ensure the successful and timely delivery of models and integration of services.

  • Coordinate with global teams to drive projects from research to production.

  • Develop new OCI services and features leveraging recent advances in generative AI, machine learning and deep learning.

  • Design and review the architecture of generative AI, including data, model, training, and evaluation, employing best practices.

  • Lead and mentor both junior and senior machine learning engineers.

  • Develop production code and advocate for the best coding and engineering practices.

  • Participate in project planning, review, and retrospective sessions.

  • Identify and mitigate risks in our plans and executions, especially at the intersection of business and engineering.

Qualifications and Experience:

  • Demonstrated experience in designing and implementing scalable AI models for production.

  • Deep technical understanding of Machine Learning, Deep Learning architectures like Transformers, training methods, and optimizers.

  • Practical experience with the latest technologies in LLM and generative AI, such as parameter-efficient fine-tuning, instruction fine-tuning, and advanced prompt engineering techniques like Tree-of-Thoughts.

  • Hands-on experience with emerging LLM frameworks and plugins, such as LangChain, LlamaIndex, VectorStores and Retrievers, LLM Cache, LLMOps (MLFlow), LMQL, Guidance, etc.

  • Proven experience in designing data collection/annotation solutions and systematic evaluation necessary for developing and maintaining production systems.

  • Commitment to staying up-to-date with the field and applying academic advances to solve complex business problems, and bringing them into production.

  • Strong publication record, including as a lead author or reviewer, in top-tier journals or conferences.

  • Experienced leading junior machine learning engineer.

Preferred Qualifications:

  • Knowledge of LLM and experience delivering Generative AI And Agent models are a significant plus.

  • Familiarity and experience with the latest advancements in computer vision and multimodal modeling is a plus.


  • PhD in Computer Science, Mathematics, Statistics, Physics, Linguistics or a related field with a dissertation, thesis or final project centered in Machine Learning and Deep Learning) with 3+ years relevant experience is preferred but not a must; OR

  • Masters or Bachelor's in related field with 5+ years relevant experience

Oracle is committed to incorporating generative AI into our enterprise applications and workflows for business users. This role presents a unique opportunity to work on pioneering AI technologies and contribute to Oracle's Generative AI strategy. At Oracle, we value diversity and encourage continuous learning for career growth. Come join our team to make a significant difference!


Certain US customer or client-facing roles may be required to comply with applicable requirements, such as immunization and occupational health mandates.

Range and benefit information provided in this posting are specific to the stated locations only

US: Hiring Range: from $94,200 to $223,500 per annum. May be eligible for bonus and equity.

Oracle maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect Oracle’s differing products, industries and lines of business.

Candidates are typically placed into the range based on the preceding factors as well as internal peer equity.

Oracle US offers a comprehensive benefits package which includes the following:

  1. Medical, dental, and vision insurance, including expert medical opinion

  2. Short term disability and long term disability

  3. Life insurance and AD&D

  4. Supplemental life insurance (Employee/Spouse/Child)

  5. Health care and dependent care Flexible Spending Accounts

  6. Pre-tax commuter and parking benefits

  7. 401(k) Savings and Investment Plan with company match

  8. Paid time off: Flexible Vacation is provided to all eligible employees assigned to a salaried (non-overtime eligible) position. Accrued Vacation is provided to all other employees eligible for vacation benefits. For employees working at least 35 hours per week, the vacation accrual rate is 13 days annually for the first three years of employment and 18 days annually for subsequent years of employment. Vacation accrual is prorated for employees working between 20 and 34 hours per week. Employees working fewer than 20 hours per week are not eligible for vacation.

  9. 11 paid holidays

  10. Paid sick leave: 72 hours of paid sick leave upon date of hire. Refreshes each calendar year. Unused balance will carry over each year up to a maximum cap of 112 hours.

  11. Paid parental leave

  12. Adoption assistance

  13. Employee Stock Purchase Plan

  14. Financial planning and group legal

  15. Voluntary benefits including auto, homeowner and pet insurance

About Us

As a world leader in cloud solutions, Oracle uses tomorrow’s technology to tackle today’s problems. True innovation starts with diverse perspectives and various abilities and backgrounds.

When everyone’s voice is heard, we’re inspired to go beyond what’s been done before. It’s why we’re committed to expanding our inclusive workforce that promotes diverse insights and perspectives.

We’ve partnered with industry-leaders in almost every sector—and continue to thrive after 40+ years of change by operating with integrity.

Oracle careers open the door to global opportunities where work-life balance flourishes. We offer a highly competitive suite of employee benefits designed on the principles of parity and consistency. We put our people first with flexible medical, life insurance and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by calling +1 888 404 2494, option one.


Oracle is an Equal Employment Opportunity Employer*. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

* Which includes being a United States Affirmative Action Employer