Logo
Crusoe

Senior Software Engineer, Managed AI

Crusoe, San Francisco, California, United States, 94199

Save Job

Crusoe's mission is to accelerate the abundance of energy and intelligence. We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability.

Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.

About This Role:

The Crusoe Cloud Managed AI team seeks an ambitious and experienced Senior Software Engineer to join their team. You will have a pivotal role in shaping the architecture and scalability of our next-generation AI inference platform. You will lead the design and implementation of core systems for our AI services, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role provides the opportunity to build and scale infrastructure capable of handling millions of API requests per second across thousands of customers. From day one, you’ll own critical subsystems for managed AI inference, helping to serve large language models (LLMs) to a global audience. You’ll collaborate cross-functionally, influence the long-term vision of the platform, and contribute to cutting-edge AI technologies. This is a unique opportunity to build a high-performance AI product central to Crusoe's business growth.

This is an on-site role based in San Francisco, CA, or Sunnyvale, CA, requiring in-office presence.

What You’ll Be Working On

Design and develop core infrastructure for the Managed AI platform, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms; build and optimize systems for high-volume AI inference handling millions of API requests per second; develop and maintain core services for AI model deployment and management.

Collaborate with cross-functional teams — product managers, data scientists, and other engineers — to define and deliver AI services; integrate with other Crusoe Cloud services to provide a seamless user experience; work with research and development teams to explore and implement new AI technologies.

Ensure high availability and performance by designing systems with low latency and fault tolerance; optimize performance across the AI inference pipeline and monitor reliability of AI services.

What You’ll Bring to the Team

Strong Engineering Foundations:

Advanced degree in Computer Science, Engineering, or related field; experience in distributed systems design and implementation; cloud services experience (elastic compute, object storage, VPCs, managed databases, etc.); experience with container runtimes (e.g., Kubernetes) and microservices; experience with REST APIs and gRPC; familiarity with CI/CD tools.

AI/ML Expertise:

Experience in Generative AI (Large Language Models, Multimodal).

Technical Skills:

Proficiency in Golang or Python for large-scale services (preferred); familiarity with AI infrastructure (training, inference, ETL pipelines) (preferred); contributions to open-source AI projects (preferred); GPU performance optimizations for inference (preferred).

Soft Skills:

Proven track record of delivering early-stage projects under tight deadlines; strong communication and collaboration; proactive, results-oriented; ability to work independently and in a team.

Bonus Points

Experience with AI/ML frameworks such as TensorFlow, PyTorch, or Hugging Face Transformers.

Knowledge of machine learning algorithms and data structures.

Experience with data streaming and real-time processing technologies.

Contributions to open-source projects outside of AI.

Benefits

Industry competitive pay

Restricted Stock Units in a fast growing, well-funded technology company

Health insurance options (HDHP and PPO), vision and dental for you and dependents

Employer contributions to HSA

Paid parental leave

Life insurance, short-term and long-term disability

Teladoc

401(k) with 100% match up to 4% of salary

Generous paid time off and holidays

Cell phone reimbursement

Tution reimbursement

Calm app subscription

MetLife Legal

Company-paid commuter benefit; $300 per month

Compensation Compensation will be paid in the range of $166,000 - $201,000 per year plus bonus. Restricted Stock Units are included in all offers. Compensation to be determined by the applicant's knowledge, education, and abilities, as well as internal equity and market data. Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Engineering and Information Technology

Industries

Technology, Information and Internet

We’re not including extraneous postings or site-only notices in this refined description.

#J-18808-Ljbffr