Red Hat
Senior MLOps Engineer, vLLM Inference
– Red Hat
Red Hat is building an open‑source AI inference platform that brings the power of vLLM and large language models to enterprises. The Senior MLOps Engineer will work with our product and research teams to design and scale production ML pipelines, build CI/CD and DevOps infrastructure, and deliver reliable inference runtimes.
Responsibilities
Collaborate with research and product teams to scale ML products for internal and external use.
Create and manage model training and deployment pipelines.
Manage upstream and midstream product builds and releases.
Test for correctness, responsiveness, and efficiency.
Troubleshoot, debug, and upgrade Dev & Test pipelines.
Identify and deploy cybersecurity measures through vulnerability assessment and risk management.
Collaborate with cross‑functional teams on market requirements and best practices.
Keep abreast of the latest technologies and standards in the field.
Qualifications
2+ years of experience in MLOps, DevOps, automation, and modern software deployment practices.
Experience evaluating LLM performance on accelerators and accuracy (e.g., HellaSwag, MMLU, Chatbot Arena, TruthfulQA).
Proficient in Python and PyTest.
Strong experience with Git, GitHub Actions, Terraform, Jenkins, Ansible, and automation/monitoring tools.
Extensive experience administering Kubernetes/Openshift.
Familiarity with agile development methodology.
Experience with at least one cloud provider (AWS, GCP, Azure, or IBM Cloud).
Solid programming skills in Python and troubleshooting skills.
Effective communication across geographically dispersed teams.
Experience maintaining infrastructure stability.
Contributing to the vLLM CI community is a plus.
Bachelor’s degree in computer science, mathematics, or related field is valued but not required.
Compensation The salary range for this position is
$133,650.00–$220,680.00 . Actual offer will be based on qualifications and location.
Benefits
Comprehensive medical, dental, and vision coverage.
Flexible Spending Account for healthcare and dependent care.
Health Savings Account – high deductible medical plan.
401(k) with employer match.
Paid time off and holidays.
Paid parental leave plans.
Disability, paid family medical leave, and paid military leave.
Employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more.
Equal Opportunity Employer Red Hat is an equal‑opportunity workplace and an affirmative action employer. We review applications without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, disability, or marital status.
#J-18808-Ljbffr
– Red Hat
Red Hat is building an open‑source AI inference platform that brings the power of vLLM and large language models to enterprises. The Senior MLOps Engineer will work with our product and research teams to design and scale production ML pipelines, build CI/CD and DevOps infrastructure, and deliver reliable inference runtimes.
Responsibilities
Collaborate with research and product teams to scale ML products for internal and external use.
Create and manage model training and deployment pipelines.
Manage upstream and midstream product builds and releases.
Test for correctness, responsiveness, and efficiency.
Troubleshoot, debug, and upgrade Dev & Test pipelines.
Identify and deploy cybersecurity measures through vulnerability assessment and risk management.
Collaborate with cross‑functional teams on market requirements and best practices.
Keep abreast of the latest technologies and standards in the field.
Qualifications
2+ years of experience in MLOps, DevOps, automation, and modern software deployment practices.
Experience evaluating LLM performance on accelerators and accuracy (e.g., HellaSwag, MMLU, Chatbot Arena, TruthfulQA).
Proficient in Python and PyTest.
Strong experience with Git, GitHub Actions, Terraform, Jenkins, Ansible, and automation/monitoring tools.
Extensive experience administering Kubernetes/Openshift.
Familiarity with agile development methodology.
Experience with at least one cloud provider (AWS, GCP, Azure, or IBM Cloud).
Solid programming skills in Python and troubleshooting skills.
Effective communication across geographically dispersed teams.
Experience maintaining infrastructure stability.
Contributing to the vLLM CI community is a plus.
Bachelor’s degree in computer science, mathematics, or related field is valued but not required.
Compensation The salary range for this position is
$133,650.00–$220,680.00 . Actual offer will be based on qualifications and location.
Benefits
Comprehensive medical, dental, and vision coverage.
Flexible Spending Account for healthcare and dependent care.
Health Savings Account – high deductible medical plan.
401(k) with employer match.
Paid time off and holidays.
Paid parental leave plans.
Disability, paid family medical leave, and paid military leave.
Employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more.
Equal Opportunity Employer Red Hat is an equal‑opportunity workplace and an affirmative action employer. We review applications without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, ancestry, citizenship, age, veteran status, genetic information, disability, or marital status.
#J-18808-Ljbffr