The New York Consulting Group
MLOps Engineer
The New York Consulting Group - Austin, Texas, us, 78716
Work at The New York Consulting Group
Overview
- View job
Overview
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from The New York Consulting Group
Design, deploy, and optimize machine learning pipelines and LLM systems at enterprise scale. Build MLOps infrastructure that enables data scientists to move models from development to production efficiently.
Role Overview
Design, deploy, and optimize machine learning pipelines and LLM systems at enterprise scale. Build MLOps infrastructure that enables data scientists to move models from development to production efficiently. Key Responsibilities
Build end-to-end ML pipelines with CI/CD automation Deploy and optimize Large Language Models (LLMs) in production Implement model monitoring, drift detection, and retraining workflows Design MLOps infrastructure on AWS, Azure, or GCP Create LLM serving systems with vector databases and RAG architecture Manage Kubernetes clusters for ML workloads Develop model versioning and experiment tracking systems Required Skills
Core Technologies: Python
programming and software development Kubernetes, Docker
containerization and orchestration MongoDB, SQL databases
data management AWS/Azure/GCP
cloud platforms and infrastructure Apache SOLR
search and indexing Linux
system administration MLOps & LLMOps: MLOps frameworks:
MLflow, Kubeflow, Airflow, DataRobot LLM deployment
and fine-tuning experience Model serving:
TensorFlow Serving, TorchServe, Triton Vector databases:
FAISS, Pinecone, Weaviate CI/CD pipelines
Jenkins, GitHub Actions, GitLab CI Monitoring tools:
Prometheus, Grafana, ELK Stack Machine Learning: ML model lifecycle
management and optimization Distributed training
frameworks and GPU optimization Prompt engineering
and LLM evaluation Model performance
monitoring and troubleshooting Preferred Qualifications
LLM experience:
GPT, BERT, Transformer models RAG systems:
Retrieval-Augmented Generation implementation Microservices
architecture and API development Feature stores:
Feast, Tecton, or similar platforms Agile/Scrum
methodology experience Multi-cloud
deployment and management What We Offer
Work with cutting-edge AI/ML technologies Lead LLM and MLOps initiatives at scale Competitive compensation in high-growth market Collaborate with world-class engineering teams Shape the future of AI infrastructure
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at The New York Consulting Group by 2x Get notified about new Mechanical Engineer jobs in
Austin, Texas Metropolitan Area . Software Development Engineer (Full Stack), Amazon Key
Austin, TX $129,300.00-$223,600.00 5 days ago Austin, TX $109,000.00-$136,000.00 1 day ago Austin, TX $100,500.00-$173,250.00 5 days ago Austin, TX $99,500.00-$200,000.00 1 day ago Austin, TX $100,000.00-$150,000.00 1 month ago Austin, TX $150,000.00-$180,000.00 2 weeks ago Austin, TX $135,000.00-$230,000.00 1 day ago Austin, TX $90,000.00-$140,000.00 2 months ago Austin, TX $150,000.00-$175,000.00 2 months ago Austin, TX $90,000.00-$170,000.00 5 months ago Software Development Engineer (Full Stack), Amazon Key
Austin, TX $129,300.00-$223,600.00 2 days ago Austin, Texas Metropolitan Area 3 months ago Austin, TX $90,000.00-$150,000.00 1 month ago Software Development Engineer in Test – 2025 (US)
Austin, TX $105,000.00-$185,000.00 2 weeks ago Austin, TX $92,000.00-$156,000.00 2 days ago Austin, TX $139,360.00-$209,040.00 2 days ago Austin, TX $60,000.00-$140,000.00 4 days ago Austin, TX $119,120.00-$178,680.00 2 weeks ago Austin, TX $120,000.00-$160,000.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Design, deploy, and optimize machine learning pipelines and LLM systems at enterprise scale. Build MLOps infrastructure that enables data scientists to move models from development to production efficiently. Key Responsibilities
Build end-to-end ML pipelines with CI/CD automation Deploy and optimize Large Language Models (LLMs) in production Implement model monitoring, drift detection, and retraining workflows Design MLOps infrastructure on AWS, Azure, or GCP Create LLM serving systems with vector databases and RAG architecture Manage Kubernetes clusters for ML workloads Develop model versioning and experiment tracking systems Required Skills
Core Technologies: Python
programming and software development Kubernetes, Docker
containerization and orchestration MongoDB, SQL databases
data management AWS/Azure/GCP
cloud platforms and infrastructure Apache SOLR
search and indexing Linux
system administration MLOps & LLMOps: MLOps frameworks:
MLflow, Kubeflow, Airflow, DataRobot LLM deployment
and fine-tuning experience Model serving:
TensorFlow Serving, TorchServe, Triton Vector databases:
FAISS, Pinecone, Weaviate CI/CD pipelines
Jenkins, GitHub Actions, GitLab CI Monitoring tools:
Prometheus, Grafana, ELK Stack Machine Learning: ML model lifecycle
management and optimization Distributed training
frameworks and GPU optimization Prompt engineering
and LLM evaluation Model performance
monitoring and troubleshooting Preferred Qualifications
LLM experience:
GPT, BERT, Transformer models RAG systems:
Retrieval-Augmented Generation implementation Microservices
architecture and API development Feature stores:
Feast, Tecton, or similar platforms Agile/Scrum
methodology experience Multi-cloud
deployment and management What We Offer
Work with cutting-edge AI/ML technologies Lead LLM and MLOps initiatives at scale Competitive compensation in high-growth market Collaborate with world-class engineering teams Shape the future of AI infrastructure
Seniority level
Seniority level Mid-Senior level Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at The New York Consulting Group by 2x Get notified about new Mechanical Engineer jobs in
Austin, Texas Metropolitan Area . Software Development Engineer (Full Stack), Amazon Key
Austin, TX $129,300.00-$223,600.00 5 days ago Austin, TX $109,000.00-$136,000.00 1 day ago Austin, TX $100,500.00-$173,250.00 5 days ago Austin, TX $99,500.00-$200,000.00 1 day ago Austin, TX $100,000.00-$150,000.00 1 month ago Austin, TX $150,000.00-$180,000.00 2 weeks ago Austin, TX $135,000.00-$230,000.00 1 day ago Austin, TX $90,000.00-$140,000.00 2 months ago Austin, TX $150,000.00-$175,000.00 2 months ago Austin, TX $90,000.00-$170,000.00 5 months ago Software Development Engineer (Full Stack), Amazon Key
Austin, TX $129,300.00-$223,600.00 2 days ago Austin, Texas Metropolitan Area 3 months ago Austin, TX $90,000.00-$150,000.00 1 month ago Software Development Engineer in Test – 2025 (US)
Austin, TX $105,000.00-$185,000.00 2 weeks ago Austin, TX $92,000.00-$156,000.00 2 days ago Austin, TX $139,360.00-$209,040.00 2 days ago Austin, TX $60,000.00-$140,000.00 4 days ago Austin, TX $119,120.00-$178,680.00 2 weeks ago Austin, TX $120,000.00-$160,000.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr