Oracle
Overview
Senior Principal Software Development Engineer. This role at Oracle Cloud Infrastructure (OCI) involves designing, building, and optimizing LLM infrastructure, agent execution runtimes, and next-generation developer platforms. The engineer will collaborate with applied scientists and ML engineers to bring agentic workflows into real-world deployments at scale. This is a hands-on technical leadership position rooted in distributed systems and low-level computer science. Responsibilities
Architect and build high-throughput, low-latency serving systems for LLM inference and agent orchestration. Design agent-native runtime environments that support dynamic planning, tool calling, memory management, and long-running context. Integrate foundational AI components with OCI’s compute and networking layers. Partner with ML research to optimize model training, fine-tuning, and inference performance on GPU clusters. Own critical paths of software delivery from architectural review through implementation and post-deployment resilience. Contribute to OCI’s developer-facing agent framework. Tackle deep systems-level challenges drawing on knowledge of operating systems, compiler design, and cloud primitives. Qualifications
Minimum Qualifications BS in Computer Science or equivalent experience. 10+ years of experience in production-grade distributed systems and cloud-native software engineering. Proficiency in Go, Java, Python, or C++. Expertise in high-performance computing and ML model serving infrastructure. Deep understanding of container orchestration and CI/CD pipelines. Strong communication skills and experience mentoring across teams. Preferred Qualifications MS or PhD in Computer Science, particularly in Systems, ML Infrastructure, or Compilers. Experience with LLM serving frameworks like vLLM, FasterTransformer, DeepSpeed, or Triton. Familiarity with agent-based systems. Contributions to LLM-native developer tools and compiler IRs. Experience with vector databases, tool APIs, and event-driven workflows. Foundations in OS internals, compiler pipelines, and systems programming. Proven ability to lead large-scale architecture efforts. Why Join Us
Be at the frontier of generative AI and agent-based software interaction. Work on mission-critical projects impacting Oracle’s AI strategy. Collaborate with a globally distributed team of leading engineers and researchers. Enjoy the agility of a fast-moving team with enterprise-level resources. Compensation & Benefits
US: Hiring range in USD from $96,800 to $251,600 per year. May be eligible for bonus, equity, and compensation deferral. Oracle maintains broad salary ranges to account for knowledge, skills, experience, market conditions, locations, and product lines. Candidates are placed within the range based on factors including peer equity. Medical, dental, and vision insurance. Short-term and long-term disability; life insurance and AD&D. Flexible spending accounts; pre-tax commuter benefits. 401(k) with company match; paid time off; holidays; sick leave; parental leave. Employee Stock Purchase Plan; voluntary benefits including auto, home, and pet insurance. Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, protected veteran status, or any other characteristic protected by law. If you require accessibility assistance, contact accommodation-request_mb@oracle.com or +1 888 404 2494 (US).
#J-18808-Ljbffr
Senior Principal Software Development Engineer. This role at Oracle Cloud Infrastructure (OCI) involves designing, building, and optimizing LLM infrastructure, agent execution runtimes, and next-generation developer platforms. The engineer will collaborate with applied scientists and ML engineers to bring agentic workflows into real-world deployments at scale. This is a hands-on technical leadership position rooted in distributed systems and low-level computer science. Responsibilities
Architect and build high-throughput, low-latency serving systems for LLM inference and agent orchestration. Design agent-native runtime environments that support dynamic planning, tool calling, memory management, and long-running context. Integrate foundational AI components with OCI’s compute and networking layers. Partner with ML research to optimize model training, fine-tuning, and inference performance on GPU clusters. Own critical paths of software delivery from architectural review through implementation and post-deployment resilience. Contribute to OCI’s developer-facing agent framework. Tackle deep systems-level challenges drawing on knowledge of operating systems, compiler design, and cloud primitives. Qualifications
Minimum Qualifications BS in Computer Science or equivalent experience. 10+ years of experience in production-grade distributed systems and cloud-native software engineering. Proficiency in Go, Java, Python, or C++. Expertise in high-performance computing and ML model serving infrastructure. Deep understanding of container orchestration and CI/CD pipelines. Strong communication skills and experience mentoring across teams. Preferred Qualifications MS or PhD in Computer Science, particularly in Systems, ML Infrastructure, or Compilers. Experience with LLM serving frameworks like vLLM, FasterTransformer, DeepSpeed, or Triton. Familiarity with agent-based systems. Contributions to LLM-native developer tools and compiler IRs. Experience with vector databases, tool APIs, and event-driven workflows. Foundations in OS internals, compiler pipelines, and systems programming. Proven ability to lead large-scale architecture efforts. Why Join Us
Be at the frontier of generative AI and agent-based software interaction. Work on mission-critical projects impacting Oracle’s AI strategy. Collaborate with a globally distributed team of leading engineers and researchers. Enjoy the agility of a fast-moving team with enterprise-level resources. Compensation & Benefits
US: Hiring range in USD from $96,800 to $251,600 per year. May be eligible for bonus, equity, and compensation deferral. Oracle maintains broad salary ranges to account for knowledge, skills, experience, market conditions, locations, and product lines. Candidates are placed within the range based on factors including peer equity. Medical, dental, and vision insurance. Short-term and long-term disability; life insurance and AD&D. Flexible spending accounts; pre-tax commuter benefits. 401(k) with company match; paid time off; holidays; sick leave; parental leave. Employee Stock Purchase Plan; voluntary benefits including auto, home, and pet insurance. Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, protected veteran status, or any other characteristic protected by law. If you require accessibility assistance, contact accommodation-request_mb@oracle.com or +1 888 404 2494 (US).
#J-18808-Ljbffr