Pragmatike
Role Overview
Staff – Principal ML Ops Engineer at Pragmatike, a fast‑growing AI startup recognized as a Top 10 GenAI company by GTM Capital. Founded by MIT CSAIL researchers, Pragmatike is building production‑grade AI systems that power Fortune 500 clients. Location: Cambridge, MA (Eastern Time). Relocation package available. Start date: ASAP. Languages: English (required).
What you’ll do
Architect, build, and scale the end‑to‑end ML Ops pipeline—training, fine‑tuning, evaluation, rollout, and monitoring.
Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on‑prem GPU clusters.
Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
Lead implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI/CD for ML models.
Collaborate with researchers to productionize models and accelerate training/inference pipelines.
Establish ML Ops best practices, internal standards, and cross‑team tooling.
Mentor engineers and influence architectural direction across the entire AI platform.
What we’re looking for
Deep hands‑on experience designing and operating production‑scale ML systems (Staff/Principal level).
Strong background in ML Ops, distributed systems, and cloud infrastructure (AWS, GCP, or Azure).
Proficiency with Python and familiarity with TypeScript or Go for platform integration.
Expertise in ML frameworks: PyTorch, Transformers, vLLM, Llama‑factory, Megatron‑LM, CUDA/GPU acceleration.
Strong experience with containerization and orchestration (Docker, Kubernetes, Helm, autoscaling).
Deep understanding of the ML lifecycle workflows: training, fine‑tuning, evaluation, inference, model registries.
Ability to lead technical strategy, collaborate cross‑functionally, and operate in fast‑paced environments.
Bonus points
Experience deploying and operating LLMs and generative models in production at enterprise scale.
Familiarity with DevOps, CI/CD, automated deployment pipelines, and infrastructure‑as‑code.
Experience optimizing GPU clusters, scheduling, and distributed training frameworks.
Prior startup experience or comfort operating with ambiguity and high ownership.
Experience working with data engineering, feature pipelines, or real‑time ML systems.
Why this role will pivot your career
Research pedigree: MIT CSAIL founders, recognized for breakthrough AI and systems contributions.
Customer impact: Deploy AI solutions powering Fortune 500 clients.
Industry momentum: Lab alumni have led high‑value acquisitions (MosaicML, Databricks, Run:AI, Nvidia, W&B, CoreWeave).
Funding & growth: Oversubscribed seed round, next funding in 2026.
Career growth & influence: Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale.
Culture & autonomy: Own critical systems while collaborating with world‑class engineers.
Aspirational impact: Solve AI performance challenges few engineers ever face.
Benefits
Competitive salary & equity options
Sign‑on bonus
Health, dental, and vision coverage
401(k) retirement plan
Seniority Level Mid‑Senior level
Employment Type Full‑time
Job Function Education and Training
Industries IT Services and IT Consulting
Pragmatike
is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.
#J-18808-Ljbffr
What you’ll do
Architect, build, and scale the end‑to‑end ML Ops pipeline—training, fine‑tuning, evaluation, rollout, and monitoring.
Design reliable infrastructure for model deployment, versioning, reproducibility, and orchestration across cloud and on‑prem GPU clusters.
Optimize compute usage across distributed systems (Kubernetes, autoscaling, caching, GPU allocation, checkpointing workflows).
Lead implementation of observability for ML systems (monitor drift, performance, throughput, reliability, cost).
Build automated workflows for dataset curation, labeling, feature pipelines, evaluation, and CI/CD for ML models.
Collaborate with researchers to productionize models and accelerate training/inference pipelines.
Establish ML Ops best practices, internal standards, and cross‑team tooling.
Mentor engineers and influence architectural direction across the entire AI platform.
What we’re looking for
Deep hands‑on experience designing and operating production‑scale ML systems (Staff/Principal level).
Strong background in ML Ops, distributed systems, and cloud infrastructure (AWS, GCP, or Azure).
Proficiency with Python and familiarity with TypeScript or Go for platform integration.
Expertise in ML frameworks: PyTorch, Transformers, vLLM, Llama‑factory, Megatron‑LM, CUDA/GPU acceleration.
Strong experience with containerization and orchestration (Docker, Kubernetes, Helm, autoscaling).
Deep understanding of the ML lifecycle workflows: training, fine‑tuning, evaluation, inference, model registries.
Ability to lead technical strategy, collaborate cross‑functionally, and operate in fast‑paced environments.
Bonus points
Experience deploying and operating LLMs and generative models in production at enterprise scale.
Familiarity with DevOps, CI/CD, automated deployment pipelines, and infrastructure‑as‑code.
Experience optimizing GPU clusters, scheduling, and distributed training frameworks.
Prior startup experience or comfort operating with ambiguity and high ownership.
Experience working with data engineering, feature pipelines, or real‑time ML systems.
Why this role will pivot your career
Research pedigree: MIT CSAIL founders, recognized for breakthrough AI and systems contributions.
Customer impact: Deploy AI solutions powering Fortune 500 clients.
Industry momentum: Lab alumni have led high‑value acquisitions (MosaicML, Databricks, Run:AI, Nvidia, W&B, CoreWeave).
Funding & growth: Oversubscribed seed round, next funding in 2026.
Career growth & influence: Lead AI initiatives, optimize pipelines, and directly impact production AI systems at scale.
Culture & autonomy: Own critical systems while collaborating with world‑class engineers.
Aspirational impact: Solve AI performance challenges few engineers ever face.
Benefits
Competitive salary & equity options
Sign‑on bonus
Health, dental, and vision coverage
401(k) retirement plan
Seniority Level Mid‑Senior level
Employment Type Full‑time
Job Function Education and Training
Industries IT Services and IT Consulting
Pragmatike
is an Equal Opportunity Employer and is committed to providing equal employment opportunities to all applicants without discrimination. We recruit on behalf of our clients and prohibit discrimination and harassment based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. We are committed to a fair and inclusive hiring process. We process your personal data solely for recruitment purposes, in accordance with applicable privacy laws, and maintain reasonable safeguards to protect your information. Your data may be shared with our client(s) for hiring consideration, but will not be disclosed to third parties outside of the recruitment process.
#J-18808-Ljbffr