BCG Platinion | Principal Architect - AI

BCG Platinion | Principal Architect - AI

Join to apply for the BCG Platinion | Principal Architect - AI role at Boston Consulting Group (BCG) .

Locations : Atlanta, Austin, Boston, Brooklyn, Chicago, Dallas, Denver, Detroit, Houston, Miami, Minneapolis, Nashville, Summit, New York, Philadelphia, Pittsburgh, Durham, Washington.

About BCG Platinion

BCG Platinion spans across the globe, delivering digital excellence for clients with sustained solutions to complex challenges. We guide clients to push the status quo, overcome tech limitations, and enable their digital journeys. Architecture, Cybersecurity, Digital Transformation, Enterprise Application, and Risk functions push business value through innovative technology at pace.

What You'll Do

• Collaborative: Interdisciplinary team player aligning across stakeholder groups.
• Systems thinker: Design sophisticated, robust AI solutions for common business problems.
• Technical expert: Deep technology and AI expertise driving novel solutions.
• Comfortable with ambiguity: Navigate unclear paths confidently.
• Change agent: Enable organization-wide change and onboarding of new processes.
• Agile advocate: Strategically tackle challenges using agile methodologies.
• Innovative: Envision new design patterns for next‑generation tech solutions.
• Knowledgeable: Serve as a subject‑matter expert in Technology Architecture and AI Platforms.
• Strategic partner: Build hypothesis‑driven solutions with senior client stakeholders and C‑level executives.

What You'll Bring

• Bachelor's degree in IT, computer science, or related field (Master’s preferred).
• 10+ years in technology consulting or software engineering, with 5+ in architecture.
• Strong foundation in software architecture and distributed systems design.
• Proven experience designing or scaling AI/ML or LLM‑based applications.
• Programming proficiency: Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, Node.js.
• Familiarity with modern AI frameworks: LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex.
• Knowledge of Agentic AI concepts: LangChain agents, RAG, memory modules, vector DBs, function‑calling, observability, security, deployment strategies.
• Cloud architecture, data management, API integration experience; AWS Bedrock, Microsoft Azure AI Foundry, Google Vertex AI.
• Architect: Cloud platforms, autonomous agent deployment across hybrid environments, containerization (Docker, Kubernetes, Helm, Istio).
• Experience with AI coding tools: Cursor, Replit, Claude code, Codex.
• Vector DBs and context retrieval: Pinecone, QDrant, Cosmos DB, Search.
• Knowledge graphs: Neo4j.
• Excellent communication with senior executives.
• Agile mindset and ability to mentor others.
• Travel willingness: significant client travel may be required.

Who You'll Work With

Principal AI Platforms Architect will bridge high‑level system design with hands‑on AI engineering, collaborating with AI, data, product, and engineering teams to define scalable architectures for LLM‑based applications.

AI Architecture & Solution Design

• Define scalable, low‑latency AI and LLM architectures.
• Design Agentic AI solutions with memory, reflection, and task planning.
• Architect integration patterns (RAG) for model orchestration.
• Establish blueprints, governance, and responsible AI frameworks.
• Plan hybrid pipelines with cost, latency, risk considerations.

Prototyping & Validation

• Develop proofs‑of‑concept for model architectures and agent orchestration.
• Evaluate emerging AI frameworks and tools for integration suitability.
• Create solutions using n8n, Retool, OpenAI Agentkit, Microsoft Copilot Studio, AWS Flows.

Implementation Management & Support

• Restructure IT processes for new systems.
• Oversee performance, observability, and governance (LangSmith, Prometheus, Grafana, Evidently).
• Define LLMOps standards for versioning, testing, monitoring.

Communication & Collaboration

• Translate complex ideas to technical and non‑technical audiences.
• Lead presentations and workshops; build consensus.
• Mentor engineering teams on scalability and best practices.

Team Management

• Define and organize junior team work modules.
• Coach and provide quality assurance oversight.
• Promote positive team experience and embody BCG values.

Innovation & Growth

• Stay ahead of AI system tech trends (RAG, agent frameworks).
• Drive innovation and thought leadership.
• Support business development with clear technology roadmaps.

What We Offer

• Unified, interdisciplinary work environment with career development opportunities.
• Comprehensive benefits: health, dental, vision, gym reimbursement, retirement, paid time off, parental leave, family benefits.

Compensation (U.S. Applicants)

Base: $230,000 USD. Additional: discretionary performance bonus, retirement contributions, and market‑leading benefits. Full medical, dental, and vision coverage paid in full for employees and eligible families.

Equal Opportunity

Boston Consulting Group is an equal opportunity employer. All qualified applicants are considered without regard to protected characteristics or criminal history (where permitted).

BCG – E‑Verify Employer

BCG participates in E‑Verify. Click for more information.