Boston Consulting Group (BCG)
BCG Platinion | Principal Architect - AI
Boston Consulting Group (BCG), Summit, New Jersey, us, 07902
BCG Platinion | Principal Architect - AI
Title: Principal Architect - AI
Join to apply for the
BCG Platinion | Principal Architect - AI
role at
Boston Consulting Group (BCG) .
Locations Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
About BCG Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Founded in 1963, BCG helps clients with total transformation, inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom‑line impact.
About BCG Platinion BCG Platinion serves clients worldwide, delivering digital excellence through Architecture, Cybersecurity, Digital Transformation, Enterprise Application, and Risk functions. We transform business, revolutionize approaches, and create value through innovative technology.
What You'll Do
Principal AI Platforms Architects At BCG Platinion Are:
Collaborative – interdisciplinary team players who build relationships across stakeholder groups.
Systems thinkers – design robust AI solutions to common business problems.
Technical experts – critical thinkers with deep Technology & AI expertise that drives novel solutions.
Comfortable with ambiguity – navigate undefined paths confidently.
Change agents – guide organizational change and implement new processes and tools.
Agile advocates – apply agile methodologies strategically.
Innovative – envision novel design patterns for next‑generation solutions.
Knowledgeable – act as a subject‑matter expert in Technology Architecture and AI Platforms.
Strategic partners – collaborate with senior stakeholders to build hypothesis‑driven solutions at the intersection of technology and business.
What You'll Bring
Bachelor's degree in information technology, computer science, business, or related field (Master’s preferred).
10+ years of technology consulting or software engineering; 5+ years in architecture.
Strong foundation in software architecture and distributed systems.
Proven design or scaling of AI/ML or LLM‑based applications.
Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
Experience with AI frameworks such as LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex.
Knowledge of Agentic AI capabilities (RAG, memory modules, vector DBs, function‑calling, governance).
Understanding cloud architecture, data management, and API‑based integration.
Hands‑on experience with AWS Bedrock, Azure AI Foundry, Google Vertex AI.
Containerization and orchestration with Docker, Kubernetes, Helm, Istio.
AI coding tools such as Cursor, Replit, Claude code, Codex.
Experience with vector databases and embeddings (Pinecone, Qdrant, Cosmos DB, Azure Search).
Knowledge graphs experience (Neo4j) a plus.
Strong analytical, creative problem‑solving, and communication skills.
Ability to explain complex technology to senior executives.
Agile mindset and ability to manage large projects.
Willingness to travel extensively to client sites.
Who You'll Work With Design, guide, and evolve architecture of next‑generation intelligent agentic systems. Work across AI, data, product, and engineering teams to define scalable AI‑driven architectures.
AI Architecture & Solution Design
Define scalable, low‑latency AI and LLM architectures.
Design Agentic AI solutions focusing on workflow automation, reflection, and task planning.
Define integration patterns such as RAG, governance, data lineage, and responsible AI frameworks.
Architect hybrid pipelines and polyglot runtimes with cost, latency, and risk considerations.
Prototyping & Validation
Build MVPs or proof‑of‑concepts for model architectures, RAG flows, and agent orchestration.
Evaluate emerging AI frameworks and tools for suitability.
Develop solutions with n8n, Retool, Azure Copilot Studio, AWS Flows.
Implementation Management and Support
Support IT process restructuring and adoption of new systems.
Manage system performance, observability, and governance using LangSmith, Prometheus, Grafana, Evidently, WhyLogs, OpenTelemetry.
Define standards for versioning, testing, and monitoring of AI services.
Communication and Collaboration
Translate complex ideas for technical and non‑technical audiences.
Deliver presentations, workshops, and consensus‑building sessions.
Mentor teams and share knowledge across product, data, and engineering functions.
Provide direction and feedback to team members.
Team Management
Manage junior team members; define roles and provide development pathways.
Mentor through agreements and project ownership.
Ensure quality assurance and positive growth environment.
Model BCG culture and values.
Innovation and Growth
Stay current on distributed AI, RAG, indexing, and agent frameworks.
Drive innovation and uncover transformative solutions.
Serve as subject‑matter expert on LLM integration and agent system design.
Contribute to business development with technical roadmaps.
Lead client relationships autonomously.
Publish thought leadership content and speak at events.
Additional Information What We Offer
Unified interdisciplinary experience and multiple career paths.
Supportive environment fostering innovation and impact.
For U.S. Applicants Base compensation: $230,000 USD. Eligible for discretionary performance bonus and retirement contribution. Comprehensive benefits include full‑cost medical, dental, vision, and additional family benefits.
Benefits Overview
Zero‑dollar health insurance premiums for employees and family.
$10 copays for doctor visits, urgent care, and prescriptions.
Dental coverage up to $5,000 for orthodontia.
Vision insurance for glasses and contacts.
Gym membership reimbursement.
Fully vested retirement contributions.
Generous paid time off and parental leave.
Support for egg freezing, surrogacy, and adoption.
BCG is an Equal Opportunity Employer. E‑Verify participation.
Referrals increase interview chances.
#J-18808-Ljbffr
Title: Principal Architect - AI
Join to apply for the
BCG Platinion | Principal Architect - AI
role at
Boston Consulting Group (BCG) .
Locations Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
About BCG Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Founded in 1963, BCG helps clients with total transformation, inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom‑line impact.
About BCG Platinion BCG Platinion serves clients worldwide, delivering digital excellence through Architecture, Cybersecurity, Digital Transformation, Enterprise Application, and Risk functions. We transform business, revolutionize approaches, and create value through innovative technology.
What You'll Do
Principal AI Platforms Architects At BCG Platinion Are:
Collaborative – interdisciplinary team players who build relationships across stakeholder groups.
Systems thinkers – design robust AI solutions to common business problems.
Technical experts – critical thinkers with deep Technology & AI expertise that drives novel solutions.
Comfortable with ambiguity – navigate undefined paths confidently.
Change agents – guide organizational change and implement new processes and tools.
Agile advocates – apply agile methodologies strategically.
Innovative – envision novel design patterns for next‑generation solutions.
Knowledgeable – act as a subject‑matter expert in Technology Architecture and AI Platforms.
Strategic partners – collaborate with senior stakeholders to build hypothesis‑driven solutions at the intersection of technology and business.
What You'll Bring
Bachelor's degree in information technology, computer science, business, or related field (Master’s preferred).
10+ years of technology consulting or software engineering; 5+ years in architecture.
Strong foundation in software architecture and distributed systems.
Proven design or scaling of AI/ML or LLM‑based applications.
Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
Experience with AI frameworks such as LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, LlamaIndex.
Knowledge of Agentic AI capabilities (RAG, memory modules, vector DBs, function‑calling, governance).
Understanding cloud architecture, data management, and API‑based integration.
Hands‑on experience with AWS Bedrock, Azure AI Foundry, Google Vertex AI.
Containerization and orchestration with Docker, Kubernetes, Helm, Istio.
AI coding tools such as Cursor, Replit, Claude code, Codex.
Experience with vector databases and embeddings (Pinecone, Qdrant, Cosmos DB, Azure Search).
Knowledge graphs experience (Neo4j) a plus.
Strong analytical, creative problem‑solving, and communication skills.
Ability to explain complex technology to senior executives.
Agile mindset and ability to manage large projects.
Willingness to travel extensively to client sites.
Who You'll Work With Design, guide, and evolve architecture of next‑generation intelligent agentic systems. Work across AI, data, product, and engineering teams to define scalable AI‑driven architectures.
AI Architecture & Solution Design
Define scalable, low‑latency AI and LLM architectures.
Design Agentic AI solutions focusing on workflow automation, reflection, and task planning.
Define integration patterns such as RAG, governance, data lineage, and responsible AI frameworks.
Architect hybrid pipelines and polyglot runtimes with cost, latency, and risk considerations.
Prototyping & Validation
Build MVPs or proof‑of‑concepts for model architectures, RAG flows, and agent orchestration.
Evaluate emerging AI frameworks and tools for suitability.
Develop solutions with n8n, Retool, Azure Copilot Studio, AWS Flows.
Implementation Management and Support
Support IT process restructuring and adoption of new systems.
Manage system performance, observability, and governance using LangSmith, Prometheus, Grafana, Evidently, WhyLogs, OpenTelemetry.
Define standards for versioning, testing, and monitoring of AI services.
Communication and Collaboration
Translate complex ideas for technical and non‑technical audiences.
Deliver presentations, workshops, and consensus‑building sessions.
Mentor teams and share knowledge across product, data, and engineering functions.
Provide direction and feedback to team members.
Team Management
Manage junior team members; define roles and provide development pathways.
Mentor through agreements and project ownership.
Ensure quality assurance and positive growth environment.
Model BCG culture and values.
Innovation and Growth
Stay current on distributed AI, RAG, indexing, and agent frameworks.
Drive innovation and uncover transformative solutions.
Serve as subject‑matter expert on LLM integration and agent system design.
Contribute to business development with technical roadmaps.
Lead client relationships autonomously.
Publish thought leadership content and speak at events.
Additional Information What We Offer
Unified interdisciplinary experience and multiple career paths.
Supportive environment fostering innovation and impact.
For U.S. Applicants Base compensation: $230,000 USD. Eligible for discretionary performance bonus and retirement contribution. Comprehensive benefits include full‑cost medical, dental, vision, and additional family benefits.
Benefits Overview
Zero‑dollar health insurance premiums for employees and family.
$10 copays for doctor visits, urgent care, and prescriptions.
Dental coverage up to $5,000 for orthodontia.
Vision insurance for glasses and contacts.
Gym membership reimbursement.
Fully vested retirement contributions.
Generous paid time off and parental leave.
Support for egg freezing, surrogacy, and adoption.
BCG is an Equal Opportunity Employer. E‑Verify participation.
Referrals increase interview chances.
#J-18808-Ljbffr