itMatch
Principal AI Infrastructure Engineer | UOP | RSUs + bonuses | 35k-39k
itMatch, Poland, New York, United States
Principal AI Infrastructure Engineer | UOP | RSUs + bonuses | 35k-39k
1 week ago Be among the first 25 applicants
For our Client, a pioneer in delivering global, secure, and high-speed digital solutions that are revolutionizing how the internet works, we are looking for:
Principal AI Infrastructure Engineer.
Do you thrive on solving complex technical challenges in AI infrastructure?
Are you ready to architect the future of AI at the edge?
Join the Client Inference Cloud Team!
The Client Inference Cloud team is part of the Client's Cloud Technology Group. We build AI platforms for efficient, compliant, and high-performing applications. These platforms support customers in running inference models and empower developers to create advanced AI solutions effectively.
The Principal Software Engineer
will lead and design a globally distributed AI inference platform with OpenAI-compatible endpoints. Responsibilities include making technical decisions, setting architectural patterns, and managing large-scale inference workloads. This position requires broad experience, extensive knowledge of AI/ML systems, and a history of successfully delivering production AI platforms.
As a Principal Software Engineer, you will be responsible for:
Architecting and designing the core infrastructure of the
Client Inference Cloud , ensuring it is performant, compliant, economical, and explainable.
Providing thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform.
Making critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration.
Mentoring engineers and collaborating with cross-functional teams to define technical requirements and elevate team capabilities.
Contributing hands‑on to critical path development, code reviews, and architectural implementations.
To be successful in this role you will:
Have broad software engineering experience with deep expertise in AI inference optimization, model serving, and LLM deployment at scale.
Demonstrate mastery of inference frameworks (TensorRT, vLLM, TorchServe, Triton), containerization strategies, and hardware‑specific optimizations for AI workloads.
Show expert‑level proficiency with cloud‑native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs.
Possess strong opinions and proven experience building platforms for AI developers (RAG, agents, fine‑tuning workflows).
Demonstrate excellent technical leadership with ability to mentor engineers, influence architectural decisions, and communicate effectively across teams.
Have deep knowledge of AI safety, responsible AI practices, and explainability frameworks.
Senior Level
Mid‑Senior level
Employment Type
Full‑time
Job Function
Information Services and Engineering Services
Referrals increase your chances of interviewing at itMatch by 2x
Get notified about new Artificial Intelligence Engineer jobs in
Poland .
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
For our Client, a pioneer in delivering global, secure, and high-speed digital solutions that are revolutionizing how the internet works, we are looking for:
Principal AI Infrastructure Engineer.
Do you thrive on solving complex technical challenges in AI infrastructure?
Are you ready to architect the future of AI at the edge?
Join the Client Inference Cloud Team!
The Client Inference Cloud team is part of the Client's Cloud Technology Group. We build AI platforms for efficient, compliant, and high-performing applications. These platforms support customers in running inference models and empower developers to create advanced AI solutions effectively.
The Principal Software Engineer
will lead and design a globally distributed AI inference platform with OpenAI-compatible endpoints. Responsibilities include making technical decisions, setting architectural patterns, and managing large-scale inference workloads. This position requires broad experience, extensive knowledge of AI/ML systems, and a history of successfully delivering production AI platforms.
As a Principal Software Engineer, you will be responsible for:
Architecting and designing the core infrastructure of the
Client Inference Cloud , ensuring it is performant, compliant, economical, and explainable.
Providing thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform.
Making critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration.
Mentoring engineers and collaborating with cross-functional teams to define technical requirements and elevate team capabilities.
Contributing hands‑on to critical path development, code reviews, and architectural implementations.
To be successful in this role you will:
Have broad software engineering experience with deep expertise in AI inference optimization, model serving, and LLM deployment at scale.
Demonstrate mastery of inference frameworks (TensorRT, vLLM, TorchServe, Triton), containerization strategies, and hardware‑specific optimizations for AI workloads.
Show expert‑level proficiency with cloud‑native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs.
Possess strong opinions and proven experience building platforms for AI developers (RAG, agents, fine‑tuning workflows).
Demonstrate excellent technical leadership with ability to mentor engineers, influence architectural decisions, and communicate effectively across teams.
Have deep knowledge of AI safety, responsible AI practices, and explainability frameworks.
Senior Level
Mid‑Senior level
Employment Type
Full‑time
Job Function
Information Services and Engineering Services
Referrals increase your chances of interviewing at itMatch by 2x
Get notified about new Artificial Intelligence Engineer jobs in
Poland .
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr