Senior AI Engineer

Overview

Join MoFo as a SENIOR AI ENGINEER on our Information Technology Team. This role can be based in Boston, New York, or Washington, D.C.

About The Role

The Senior AI Engineer, under the direction of the Director of Data Science Analytics, designs, integrates, operates, and continuously improves the firm’s generative‑AI platform built on third‑party providers such as ChatGPT Enterprise.

• Design, implement, document, and maintain scalable, secure REST/GraphQL services and SDKs that wrap third‑party LLMs and expose agentic and RAG functionality for internal developers.
• Integrate AI services with enterprise platforms including ServiceNow, Salesforce, SharePoint/OneDrive, iManage Cloud, Workday, and Microsoft 365/Copilot & Copilot Studio.
• Build and operate Model Context Protocol (MCP)‑compliant tools and servers; define resource schemas, capability negotiation, and authentication/authorization patterns.
• Maintain vector and embedding stores and RAG pipelines; tune chunking, metadata enrichment, and re‑ranking for legal‑grade accuracy.
• Provide reference implementations, SDK snippets, and quick‑start examples to accelerate adoption by IT and development teams.

ChatGPT Enterprise: Custom GPTs & Connectors

• Partner with attorneys, Knowledge Management, and business staff to identify high‑value use cases, co‑design custom GPTs with clear instructions, approved knowledge sources, and guardrails.
• Build and maintain custom connectors (Actions/OpenAPI and enterprise connectors) to systems such as ServiceNow, Salesforce, iManage, SharePoint, and internal APIs.
• Establish governance for GPTs, including naming, versioning, review workflows, RBAC/workspace scoping, and data partitioning; manage release channels and deprecations.
• Develop evaluation and safety checks and instrument usage analytics with feedback loops.
• Deliver templates, prompts, and “starter GPTs”; run enablement sessions and office hours for safe self‑service by attorneys and staff.
• Maintain runbooks and support processes for GPT incidents, drift, and provider updates.

Third‑Party AI Platform Evaluation & Selection

• Lead structured evaluations and bake‑offs against ChatGPT Enterprise baselines, defining decision criteria with AI/KM Consultants, Information Security, Governance, Risk, Procurement, and Compliance teams.
• Design representative test suites and implement automated evaluation harnesses.
• Support Information Security in performing security and privacy due diligence and align with client guidelines.
• Assess interoperability, integration effort, and RAG pipeline compatibility.
• Build proofs of concept with attorneys and staff, document ROI and risk, and recommend go/no‑go and migration plans.
• Produce decision memos detailing evaluation criteria, results, mitigations, financial impacts, and vendor lock‑in strategies.

Safety, Security, and Compliance

• Implement policy and technical controls for privacy, confidentiality, privilege, and data residency.
• Build guardrails against prompt injection, data exfiltration, and PII exposure; ensure auditability and eDiscovery readiness.
• Manage vendor diligence, provider SLAs, roadmap feedback, and incident escalation.
• Implement observability and automated regressions and canary testing for APIs, GPTs, and connectors.

Productization & Change Management

• Evaluate and prototype new AI use cases for feasibility, risk, and ROI; productionize successful pilots.
• Lead enablement for developers and non‑technical users through training, style guides, API contracts, and prompt engineering best practices.
• Contribute to Firm Responsible AI standards, guidance, and communications with stakeholders.

About You

• Bachelor’s degree in Computer Science, Software Engineering, Data Science, or a related field required; Master’s preferred.
• 8+ years of professional experience in software or AI engineering, including at least 3 years building LLM‑powered applications.
• Deep experience with cloud and DevOps technologies and one or more major cloud AI stacks (Azure preferred).
• Strong working knowledge of retrieval systems, vector databases, embeddings, and agent frameworks such as Semantic Kernel or LangChain.
• Proven experience with ChatGPT Enterprise, custom GPT design, and secure tool integration.

Domain And Compliance (Preferred)

• Experience in legal or highly regulated industries with familiarity in confidentiality, privilege, retention, and client OCGs.
• Exposure to Microsoft 365 Copilot, Copilot Studio, Microsoft Graph connectors, and Teams/SharePoint extensibility.
• Understanding of SOC 2 and ISO 27001 controls, DLP, eDiscovery, and data‑classification best practices.

Teamwork And Applied Skills

• Strong ownership mindset with the ability to drive initiatives end‑to‑end.
• Excellent organizational and project management skills.
• Exceptional analytical and communication skills.
• High attention to detail and proactive problem‑solving.
• Collaborative team player in a dynamic environment.
• Commitment to client service excellence and continuous improvement.

About MoFo

At MoFo, we collaborate across borders, practice areas, and business functions and value fresh ideas and innovation over conformity and competition.

About Our Benefits

• Medical, dental, vision, life, and disability coverage.
• Industry‑leading parental leave and family benefits.
• Global wellness program including free access to Talkspace and Calm.
• Annual community service day and birthday holiday.
• Education reimbursement and talent development team.
• Competitive annual profit‑sharing contribution.

Where required by law, salary ranges are stated below. Additional compensation may include a discretionary bonus, overtime, health/welfare benefits, retirement contributions, paid holidays, and PTO. The range displayed is specifically for positions performed in Boston, Washington, DC, and New York.

Application deadline: May 13 2026.

#J-18808-Ljbffr