Software Engineer, AI Inference Platform

Software Engineer, AI Inference Platform

Join to apply for the Software Engineer, AI Inference Platform role at ElastixAI

Software Engineer, AI Inference Platform

Join to apply for the Software Engineer, AI Inference Platform role at ElastixAI

Get AI-powered advice on this job and more exclusive features.

ElastixAI is an early-stage startup poised to revolutionize AI inference infrastructure. We are developing a cutting-edge AI inference solution that dramatically improves efficiency. Our solution is going to dynamically adapt to any deployment, constantly evolving to power the next generation AI use cases.

Role Summary:

We are looking for a talented Software Engineer to play a key role in building our core AI inference platform. You will be responsible for designing and developing critical components, including our ML model deployment system, innovative model sharding methodologies, and sophisticated performance simulators. This is a highly interdisciplinary role where you'll collaborate closely with ML, systems, and cloud engineers to ensure our entire stack works in harmony to deliver optimal AI inference solutions.

Key Responsibilities:

• Design, develop, and maintain core components of our ML deployment platform, focusing on scalability, reliability, and ease of use.
• Research, prototype, and implement advanced model sharding and distribution strategies to optimize inference performance across diverse hardware targets.
• Develop and enhance a detailed performance simulator to model and predict the behavior of AI models on various infrastructure configurations.
• Collaborate with ML engineers to integrate and support optimized models within the deployment pipeline.
• Work with cloud and systems engineers to ensure efficient utilization of underlying hardware resources.
• Contribute to the design of APIs and tools that enable seamless integration and management of our inference solutions.
• Write clean, maintainable, and well-tested code.
• Participate in the full software development lifecycle, from design and implementation to testing and deployment.

Required Qualifications:

• BS/MS/PhD in Computer Science, Software Engineering, or a related field.
• 3+ years of professional software development experience, with a focus on systems programming, distributed systems, or ML infrastructure.
• Strong proficiency in one or more programming languages such as Python, C++, or Go.
• Experience with ML frameworks (e.g., PyTorch, TensorFlow, JAX) and understanding of ML model deployment challenges.
• Solid understanding of software engineering best practices, including data structures, algorithms, and testing.
• Excellent problem-solving abilities and a knack for tackling complex technical challenges.
• Strong communication skills and a proven ability to collaborate effectively in a cross-functional team environment.
• Ability to thrive in a fast-paced, dynamic startup environment.

Preferred/Bonus Qualifications:

• Experience with containerization and orchestration technologies (e.g., Docker, Kubernetes).
• Familiarity with performance analysis, profiling, and optimization techniques.
• Experience building or working with performance modeling or simulation tools.
• Knowledge of network protocols and distributed computing concepts.
• Experience with cloud platforms (AWS, GCP, Azure).

What We Offer:

• A chance to be a foundational engineer in an innovative AI startup
• A dynamic and collaborative work environment and the change to have a significant impact on new technology
• The opportunity to work on challenging problems at the intersection of ML, software, and systems.
• Competitive compensation and startup equity package
• Comprehensive medical, dental, and vision coverage (100% paid by employer)
• Life insurance and AD&D
• Flexible Time Off (FTO)
• 12-paid holidays
• Paid parental leave
• Gym or fitness benefit
• Weekly catered lunches in the office
• Investment in employee learning & development

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development

Referrals increase your chances of interviewing at ElastixAI by 2x

Sign in to set job alerts for “Software Engineer” roles.

Seattle, WA $140,000.00-$180,000.00 1 month ago

Seattle, WA $140,000.00-$240,000.00 2 months ago

Seattle, WA $110,400.00-$138,000.00 2 weeks ago

Seattle, WA $140,000.00-$180,000.00 1 month ago

Bellevue, WA $157,000.00-$230,000.00 1 week ago

Software Engineer, Full-Stack (Austin/ Seattle)

Seattle, WA $150,500.00-$269,200.00 3 weeks ago

Software Development Engineer - 2025 (US)

Seattle, WA $99,500.00-$200,000.00 1 week ago

Bellevue, WA $157,000.00-$230,000.00 1 week ago

Seattle, WA $99,500.00-$200,000.00 1 week ago

Seattle, WA $150,000.00-$175,000.00 2 months ago

Seattle, WA $140,000.00-$180,000.00 1 month ago

Seattle, WA $108,000.00-$130,000.00 2 weeks ago

Software Engineer III, Full Stack, Google Ads

Kirkland, WA $141,000.00-$202,000.00 2 weeks ago

Redmond, WA $99,500.00-$200,000.00 1 day ago

Bellevue, WA $157,000.00-$230,000.00 1 hour ago

California, United States $100,000.00-$720,000.00 1 day ago

Seattle, WA $128,000.00-$160,000.00 2 weeks ago

Seattle, WA $99,500.00-$200,000.00 3 days ago

Seattle, WA $99,500.00-$200,000.00 3 days ago

Seattle, WA $130,000.00-$200,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr