Epoch Biodesign
Engineering Manager, Managed AI
Epoch Biodesign, San Francisco, California, United States, 94199
Overview
Crusoe is building the World’s Favorite AI-first Cloud infrastructure company. We’re pioneering vertically integrated, purpose-built AI infrastructure solutions trusted by Fortune 500 companies to power their most advanced AI applications. Crusoe is redefining AI cloud infrastructure, with a mission to align the future of computing with the future of the climate. Our AI platform is recognized as the "gold standard" for reliability and performance. Our data centers are optimized for AI workloads and are powered by clean, renewable energy.
Be part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.
Responsibilities
Lead the design and implementation of core AI services, including:
Resilient fault-tolerant queues for efficient task distribution.
Model catalogs for managing and versioning AI models.
Scheduling mechanisms optimized for cost and performance.
High-performance APIs for serving AI models to customers.
Build and scale infrastructure to handle millions of API requests per second.
Optimize AI inference performance on GPU-based systems.
Implement robust monitoring and alerting to ensure system health and availability.
Collaborate closely with product management, business strategy, and other engineering teams.
Influence the long-term vision and architectural decisions of the AI platform.
Contribute to open-source AI frameworks and participate in the AI community.
Prototype and iterate on new features and technologies.
Qualifications
Strong Engineering Fundamentals:
Advanced degree in Computer Science, Engineering, or a related field.
Demonstrable experience in distributed systems design and implementation.
Proven track record of delivering early-stage projects under tight deadlines.
Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed database, etc.
AI/ML Expertise:
Experience in Generative AI (Large Language Models, Multimodal).
Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
Software Engineering Skills:
Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
Experience using REST APIs and common communication protocols, such as gRPC.
Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
Preferred Qualifications:
Proficiency in Golang or Python for large-scale, production-level services.
Contributions to open-source AI projects such as VLLM or similar frameworks.
Performance optimizations on GPU systems and inference frameworks.
Personal Attributes:
Proactive and collaborative approach with the ability to work autonomously.
Strong communication and interpersonal skills.
Passion for building cutting-edge AI products and solving challenging technical problems.
Benefits
Hybrid work schedule
Industry competitive pay
Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit; $50 per pay period
Compensation Compensation will be paid up to $250,000 base salary. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.
Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.
#J-18808-Ljbffr
Be part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure.
Responsibilities
Lead the design and implementation of core AI services, including:
Resilient fault-tolerant queues for efficient task distribution.
Model catalogs for managing and versioning AI models.
Scheduling mechanisms optimized for cost and performance.
High-performance APIs for serving AI models to customers.
Build and scale infrastructure to handle millions of API requests per second.
Optimize AI inference performance on GPU-based systems.
Implement robust monitoring and alerting to ensure system health and availability.
Collaborate closely with product management, business strategy, and other engineering teams.
Influence the long-term vision and architectural decisions of the AI platform.
Contribute to open-source AI frameworks and participate in the AI community.
Prototype and iterate on new features and technologies.
Qualifications
Strong Engineering Fundamentals:
Advanced degree in Computer Science, Engineering, or a related field.
Demonstrable experience in distributed systems design and implementation.
Proven track record of delivering early-stage projects under tight deadlines.
Expertise in using cloud-based services, such as elastic compute, object storage, virtual private networks, managed database, etc.
AI/ML Expertise:
Experience in Generative AI (Large Language Models, Multimodal).
Familiarity with AI infrastructure, including training, inference, and ETL pipelines.
Software Engineering Skills:
Experience with container runtimes (e.g., Kubernetes) and microservices architectures.
Experience using REST APIs and common communication protocols, such as gRPC.
Demonstrated experience in the software development cycle and familiarity with CI/CD tools.
Preferred Qualifications:
Proficiency in Golang or Python for large-scale, production-level services.
Contributions to open-source AI projects such as VLLM or similar frameworks.
Performance optimizations on GPU systems and inference frameworks.
Personal Attributes:
Proactive and collaborative approach with the ability to work autonomously.
Strong communication and interpersonal skills.
Passion for building cutting-edge AI products and solving challenging technical problems.
Benefits
Hybrid work schedule
Industry competitive pay
Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit; $50 per pay period
Compensation Compensation will be paid up to $250,000 base salary. Restricted Stock Units are included in all offers. Compensation to be determined by the applicants knowledge, education, and abilities, as well as internal equity and alignment with market data.
Crusoe is an Equal Opportunity Employer. Employment decisions are made without regard to race, color, religion, disability, genetic information, pregnancy, citizenship, marital status, sex/gender, sexual preference/ orientation, gender identity, age, veteran status, national origin, or any other status protected by law or regulation.
#J-18808-Ljbffr