Logo
GEICO

Director of Engineering, AI Infrastructure

GEICO, New York, New York, us, 10261

Save Job

Director of Engineering, AI Infrastructure Join to apply for the

Director of Engineering, AI Infrastructure

role at

GEICO

This role is part of GEICO’s mission to become an AI-native insurer. The Director will lead GEICO’s AI/ML infrastructure initiatives, architecting, scaling, and operationalizing the foundational AI/ML platforms and services that power the next generation of intelligent insurance products.

Base Pay Range: $150,000.00/yr - $300,000.00/yr

Key Responsibilities

Lead and scale the AI Infrastructure engineering team, fostering technical excellence, innovation, and operational rigor.

Define and execute the strategic roadmap for GEICO’s AI infrastructure, ensuring alignment with business goals and AI/ML platform needs.

Oversee delivery of core infrastructure components, including:

GPU and distributed training platforms (e.g., AnyScale/Ray)

LLM inference and fine‑tuning platforms (OpenAI, Fireworks, in‑house)

Feature store and real‑time data pipelines

ML observability and monitoring systems

Drive MLOps best practices across model development, CI/CD, performance tracking, and governance.

Ensure infrastructure scalability, reliability, and compliance with internal and external security/privacy standards.

Collaborate with research and innovation teams on advanced initiatives like quantum ML and confidential AI.

Lead cross‑cutting programs including cost optimization, model lifecycle management (Model Hive), and standardized model development (MDLC).

Mentor senior engineering leaders and establish a high‑performing, inclusive team culture.

Influence enterprise‑wide architectural decisions and represent the AI infra organization across technical forums.

Minimum Qualifications

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

10+ years of experience in software or infrastructure engineering, with 5+ years in technical leadership roles.

Proven experience building and scaling AI/ML infrastructure, including GPU clusters, distributed training, and real‑time model serving.

Expertise with AI/ML frameworks (e.g., PyTorch, TensorFlow) and orchestration tools (e.g., Ray, Kubernetes, Docker).

Strong grasp of MLOps, data governance, and ML observability best practices.

Deep familiarity with cloud platforms (AWS, GCP, or Azure) and modern CI/CD practices.

Experience leading cross‑functional engineering teams and managing technical delivery at scale.

Preferred Qualifications

Experience with LLMs (e.g., OpenAI, Fireworks) and advanced techniques such as RAG and agent‑based orchestration.

Knowledge of privacy‑preserving AI, including federated learning and differential privacy.

Familiarity with semantic data models, streaming feature stores, and confidential computing.

Exposure to quantum computing concepts applied to ML workloads.

Strong executive presence, with the ability to influence technical and non‑technical stakeholders.

Contributions to open‑source projects, patents, or technical publications in the AI infrastructure space.

What We Offer

Opportunity to shape the AI infrastructure of a Fortune 100 company undergoing AI transformation.

A collaborative, mission‑driven culture that values innovation and impact.

Access to cutting‑edge tools, frameworks, and research opportunities.

Competitive compensation, equity, and benefits package.

Flexible work arrangements and strong commitment to work‑life balance.

Ongoing learning and career development in AI/ML and cloud‑native infrastructure.

Annual Salary: $150,000.00 - $300,000.00

At this time, GEICO will not sponsor a new applicant for employment authorization for this position.

GEICO EEO Statement

The equal employment opportunity policy of the GEICO Companies provides for a fair and equal employment opportunity for all associates and job applicants regardless of race, color, religious creed, national origin, ancestry, age, gender, pregnancy, sexual orientation, gender identity, marital status, familial status, disability or genetic information, in compliance with applicable federal, state and local law. GEICO hires and promotes individuals solely on the basis of their qualifications for the job to be filled.

GEICO reasonably accommodates qualified individuals with disabilities to enable them to receive equal employment opportunity and/or perform the essential functions of the job, unless the accommodation would impose an undue hardship to the Company. This applies to all applicants and associates. GEICO also provides a work environment in which each associate is able to be productive and work to the best of their ability. We do not condone or tolerate an atmosphere of intimidation or harassment. We expect and require the cooperation of all associates in maintaining an atmosphere free from discrimination and harassment with mutual respect by and for all associates and applicants.

#J-18808-Ljbffr