Broadcom
Senior Software Engineer, Tanzu Intelligent Assist
Broadcom, California, Missouri, United States, 65018
Senior Software Engineer, Tanzu Intelligent Assist
Broadcom
About the Role We are seeking a Staff Engineer to lead the design, development, and scaling of our end-to-end machine learning systems. In this hands‑on role, you will take ownership of the entire ML lifecycle, from architecting robust backend services to deploying and monitoring highly‑available LLM‑powered systems in production.
This is a senior position on a small, high‑impact team. You will translate state‑of‑the‑art research into tangible product features that deliver new value to our users. You’ll work across the stack, ensuring that our systems are not only performant and scalable, but also secure, observable, and built for long‑term maintainability.
Responsibilities
Architect, build, and maintain highly scalable backend services and APIs in Java and Python to support ML and LLM workloads.
Lead the deployment and integration of LLM and ML capabilities into our core products, collaborating closely with product managers, data scientists, and other engineering teams.
Take ownership of the production environment, including containerization, CI/CD pipelines (GitHub Actions), and Kubernetes deployments to ensure system reliability and performance at scale.
Implement comprehensive observability through logging, monitoring, and metrics, anticipating potential failure modes and building in robust safeguards.
Drive technical initiatives and provide mentorship to teammates, establishing and championing engineering best practices and technical standards.
Ensure security and privacy are considered at every stage of the development and operations lifecycle, adhering to industry best practices.
Qualifications Required
Bachelor of Science degree in Computer Science or related field and a minimum of 5+ years of experience OR Master’s Degree with 4+ years of relevant experience.
Extensive experience designing, developing, and deploying end-to-end machine learning systems into a production environment.
Hands‑on expertise with LLM systems and the modern LLM ecosystem.
Proven expertise in backend engineering with Java and Python.
Deep production experience with containerization (Docker) and Kubernetes.
Strong understanding of CI/CD principles with practical experience building and managing pipelines.
Solid experience with observability and operational readiness, including monitoring and logging tools.
A strong grasp of security and privacy fundamentals in software development.
Must have legal authorization to work in the U.S.
Preferred
Familiarity with modern cloud infrastructure, including public cloud platforms (AWS, GCP, or Azure), infrastructure‑as‑code tools (Terraform), Kubernetes tooling (Helm), and observability stacks (Prometheus and Grafana).
Experience with distributed systems at scale.
Familiarity with other programming languages like Golang or C++.
Demonstrated ability to lead technical initiatives and influence a cross‑functional team.
Knowledge of compliance frameworks (GDPR, SOC2, etc.).
Compensation And Benefits The annual base salary range for this position is $91,000 - $162,000. This position is also eligible for a discretionary annual bonus, and equity in accordance with our equity plan. Broadcom offers a comprehensive benefits package: medical, dental and vision plans, 401(k) with company matching, Employee Stock Purchase Program, Employee Assistance Program, paid holidays, paid sick leave and vacation time, and compliance with applicable Paid Family Leave laws.
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Engineering and Information Technology
Industries: Semiconductor Manufacturing
#J-18808-Ljbffr
About the Role We are seeking a Staff Engineer to lead the design, development, and scaling of our end-to-end machine learning systems. In this hands‑on role, you will take ownership of the entire ML lifecycle, from architecting robust backend services to deploying and monitoring highly‑available LLM‑powered systems in production.
This is a senior position on a small, high‑impact team. You will translate state‑of‑the‑art research into tangible product features that deliver new value to our users. You’ll work across the stack, ensuring that our systems are not only performant and scalable, but also secure, observable, and built for long‑term maintainability.
Responsibilities
Architect, build, and maintain highly scalable backend services and APIs in Java and Python to support ML and LLM workloads.
Lead the deployment and integration of LLM and ML capabilities into our core products, collaborating closely with product managers, data scientists, and other engineering teams.
Take ownership of the production environment, including containerization, CI/CD pipelines (GitHub Actions), and Kubernetes deployments to ensure system reliability and performance at scale.
Implement comprehensive observability through logging, monitoring, and metrics, anticipating potential failure modes and building in robust safeguards.
Drive technical initiatives and provide mentorship to teammates, establishing and championing engineering best practices and technical standards.
Ensure security and privacy are considered at every stage of the development and operations lifecycle, adhering to industry best practices.
Qualifications Required
Bachelor of Science degree in Computer Science or related field and a minimum of 5+ years of experience OR Master’s Degree with 4+ years of relevant experience.
Extensive experience designing, developing, and deploying end-to-end machine learning systems into a production environment.
Hands‑on expertise with LLM systems and the modern LLM ecosystem.
Proven expertise in backend engineering with Java and Python.
Deep production experience with containerization (Docker) and Kubernetes.
Strong understanding of CI/CD principles with practical experience building and managing pipelines.
Solid experience with observability and operational readiness, including monitoring and logging tools.
A strong grasp of security and privacy fundamentals in software development.
Must have legal authorization to work in the U.S.
Preferred
Familiarity with modern cloud infrastructure, including public cloud platforms (AWS, GCP, or Azure), infrastructure‑as‑code tools (Terraform), Kubernetes tooling (Helm), and observability stacks (Prometheus and Grafana).
Experience with distributed systems at scale.
Familiarity with other programming languages like Golang or C++.
Demonstrated ability to lead technical initiatives and influence a cross‑functional team.
Knowledge of compliance frameworks (GDPR, SOC2, etc.).
Compensation And Benefits The annual base salary range for this position is $91,000 - $162,000. This position is also eligible for a discretionary annual bonus, and equity in accordance with our equity plan. Broadcom offers a comprehensive benefits package: medical, dental and vision plans, 401(k) with company matching, Employee Stock Purchase Program, Employee Assistance Program, paid holidays, paid sick leave and vacation time, and compliance with applicable Paid Family Leave laws.
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Engineering and Information Technology
Industries: Semiconductor Manufacturing
#J-18808-Ljbffr