Boston Consulting Group (BCG)
BCG Platinion | Principal Architect - AI
Boston Consulting Group (BCG), Durham, North Carolina, United States, 27703
BCG Platinion | Principal Architect - AI
– Boston Consulting Group (BCG)
Locations:
Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
About BCG Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Founded in 1963, BCG is a pioneer in business strategy, now helping clients with total transformation‑inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom‑line impact. BCG’s cross‑functional, global teams combine deep industry expertise with a range of perspectives to spark change and deliver solutions through leading‑edge management consulting, technology, design, corporate and digital ventures, and business purpose.
About BCG Platinion BCG Platinion has a presence worldwide, with offices across Asia, Europe, and the Americas. It delivers digital excellence by providing sustained solutions to the most complex and time‑sensitive challenges. Platinion guides clients in the future, breaking the status quo, overcoming tech limitations, and enabling transformative digital journeys through architecture, cybersecurity, digital transformation, enterprise application, and risk functions.
What You’ll Do
Collaborate as an interdisciplinary team player, establishing relationships across cross‑functional stakeholder groups and existing teams.
Think systemically and design sophisticated, robust AI solutions for common business problems.
Provide technical expertise, driving novel solutions through deep AI and technology knowledge.
Navigate ambiguity with confidence, steering unknown paths toward viable solutions.
Act as a change agent, aligning and onboarding teams to implement new processes and toolsets.
Advocate agile methodologies, tackling challenges strategically and driving change.
Innovate by applying deep architecture and AI platform expertise to envision novel design patterns for the next generation of technology solutions.
Serve as a strategic partner to senior client stakeholders, bridging IT and business functions to align technology strategies with organizational goals.
What You’ll Bring
Bachelor’s degree in information technology, business administration, computer science, information systems, or a related field (Master’s degree is a plus).
10+ years of technology consulting or software engineering experience, with over 5 years in architecture discipline.
Strong foundation in software architecture and distributed systems design.
Proven experience designing or scaling AI/ML or LLM‑based applications.
Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
Familiarity with modern AI frameworks such as LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, and LlamaIndex.
Understanding of Agentic AI capabilities, including agents, RAG, memory modules, vector DBs, function‑calling, observability, safety, and governance.
Knowledge of cloud architecture, data management, and API‑based system integration, with experience in AWS (Bedrock, AgentCore), Azure AI Foundry, and Google Vertex AI.
Containerization and orchestration skills (Docker, Kubernetes, Helm, Istio, GPU autoscaling).
Experience with AI coding tools (Cursor, Replit, Claude code, Codex) and vector databases (Pinecone, QDrant).
Optional: knowledge of Neo4j, mem0, Redis Memory, or Postgres Memory.
Outstanding creativity, autonomy, analytical thinking, and focus on customer outcomes.
Superior technical knowledge, engineering rigor, and ability to explain complex technology topics to senior executives.
Agile mindset, vision for iterative migration, and experience managing large, complex projects.
Pre‑existing ability to travel to client sites as required.
Who You’ll Work With As a Principal AI Platforms Architect, you will design, guide, and evolve the architecture of next‑generation intelligent agentic systems. Your role bridges high‑level system design with hands‑on AI engineering, enabling seamless integration of LLMs, data pipelines, and enterprise systems.
Key Responsibilities
Define scalable, low‑latency AI and LLM‑based system architectures and governance frameworks for model versioning, data lineage, and responsible AI.
Design Agentic AI solutions for business workflow automation, including memory, reflection, and task planning.
Create AI integration patterns (RAG, orchestrated prompts) and hybrid pipelines, balancing cost, latency, and risk.
Develop prototypes and proofs of concept for model architectures, evaluate emerging AI frameworks, and assess suitability for integration.
Support IT process re‑structuring, oversee system performance, observability, and governance during production transition using tools such as LangSmith, Prometheus, and Grafana.
Draft compelling narratives and presentations for technical and non‑technical audiences, building consensus with clients and internal teams.
Mentor junior team members, review their work, and foster a positive learning environment.
Drive innovation and thought leadership, contributing to publications and speaking engagements.
Compensation & Benefits Base compensation: $230,000 USD. Eligibility for annual discretionary performance bonuses and retirement contributions. Comprehensive benefits include: zero‑cost medical, dental, and vision coverage; generic drug copays of $10; dental and vision coverage; gym reimbursement; fully vested retirement contributions; generous PTO, paid parental leave, and extended family benefits. Additional details available on BCG’s benefits page.
Equal Opportunity Employment Boston Consulting Group is an equal‑opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, age, sex, sexual orientation, religion, disability, or other protected characteristics. BCG complies with applicable federal, state, and local laws and reflects diverse talent in its workforce.
Seniority, Employment Type & Job Function
Seniority level: Mid‑Senior level
Employment type: Full‑time
Job functions: Design, Art/Creative, and Information Technology
Industries: Business Consulting and Services
#J-18808-Ljbffr
– Boston Consulting Group (BCG)
Locations:
Atlanta | Austin | Boston | Brooklyn | Chicago | Dallas | Denver | Detroit | Houston | Miami | Minneapolis | Nashville | Summit | New York | Philadelphia | Pittsburgh | Durham | Washington
About BCG Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Founded in 1963, BCG is a pioneer in business strategy, now helping clients with total transformation‑inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom‑line impact. BCG’s cross‑functional, global teams combine deep industry expertise with a range of perspectives to spark change and deliver solutions through leading‑edge management consulting, technology, design, corporate and digital ventures, and business purpose.
About BCG Platinion BCG Platinion has a presence worldwide, with offices across Asia, Europe, and the Americas. It delivers digital excellence by providing sustained solutions to the most complex and time‑sensitive challenges. Platinion guides clients in the future, breaking the status quo, overcoming tech limitations, and enabling transformative digital journeys through architecture, cybersecurity, digital transformation, enterprise application, and risk functions.
What You’ll Do
Collaborate as an interdisciplinary team player, establishing relationships across cross‑functional stakeholder groups and existing teams.
Think systemically and design sophisticated, robust AI solutions for common business problems.
Provide technical expertise, driving novel solutions through deep AI and technology knowledge.
Navigate ambiguity with confidence, steering unknown paths toward viable solutions.
Act as a change agent, aligning and onboarding teams to implement new processes and toolsets.
Advocate agile methodologies, tackling challenges strategically and driving change.
Innovate by applying deep architecture and AI platform expertise to envision novel design patterns for the next generation of technology solutions.
Serve as a strategic partner to senior client stakeholders, bridging IT and business functions to align technology strategies with organizational goals.
What You’ll Bring
Bachelor’s degree in information technology, business administration, computer science, information systems, or a related field (Master’s degree is a plus).
10+ years of technology consulting or software engineering experience, with over 5 years in architecture discipline.
Strong foundation in software architecture and distributed systems design.
Proven experience designing or scaling AI/ML or LLM‑based applications.
Proficiency in Python, JavaScript, TensorFlow, Keras, PyTorch, TypeScript, or Node.js.
Familiarity with modern AI frameworks such as LangChain, LangGraph, Google ADK, Strands, Semantic Kernel, AutoGen, CrewAI, and LlamaIndex.
Understanding of Agentic AI capabilities, including agents, RAG, memory modules, vector DBs, function‑calling, observability, safety, and governance.
Knowledge of cloud architecture, data management, and API‑based system integration, with experience in AWS (Bedrock, AgentCore), Azure AI Foundry, and Google Vertex AI.
Containerization and orchestration skills (Docker, Kubernetes, Helm, Istio, GPU autoscaling).
Experience with AI coding tools (Cursor, Replit, Claude code, Codex) and vector databases (Pinecone, QDrant).
Optional: knowledge of Neo4j, mem0, Redis Memory, or Postgres Memory.
Outstanding creativity, autonomy, analytical thinking, and focus on customer outcomes.
Superior technical knowledge, engineering rigor, and ability to explain complex technology topics to senior executives.
Agile mindset, vision for iterative migration, and experience managing large, complex projects.
Pre‑existing ability to travel to client sites as required.
Who You’ll Work With As a Principal AI Platforms Architect, you will design, guide, and evolve the architecture of next‑generation intelligent agentic systems. Your role bridges high‑level system design with hands‑on AI engineering, enabling seamless integration of LLMs, data pipelines, and enterprise systems.
Key Responsibilities
Define scalable, low‑latency AI and LLM‑based system architectures and governance frameworks for model versioning, data lineage, and responsible AI.
Design Agentic AI solutions for business workflow automation, including memory, reflection, and task planning.
Create AI integration patterns (RAG, orchestrated prompts) and hybrid pipelines, balancing cost, latency, and risk.
Develop prototypes and proofs of concept for model architectures, evaluate emerging AI frameworks, and assess suitability for integration.
Support IT process re‑structuring, oversee system performance, observability, and governance during production transition using tools such as LangSmith, Prometheus, and Grafana.
Draft compelling narratives and presentations for technical and non‑technical audiences, building consensus with clients and internal teams.
Mentor junior team members, review their work, and foster a positive learning environment.
Drive innovation and thought leadership, contributing to publications and speaking engagements.
Compensation & Benefits Base compensation: $230,000 USD. Eligibility for annual discretionary performance bonuses and retirement contributions. Comprehensive benefits include: zero‑cost medical, dental, and vision coverage; generic drug copays of $10; dental and vision coverage; gym reimbursement; fully vested retirement contributions; generous PTO, paid parental leave, and extended family benefits. Additional details available on BCG’s benefits page.
Equal Opportunity Employment Boston Consulting Group is an equal‑opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, age, sex, sexual orientation, religion, disability, or other protected characteristics. BCG complies with applicable federal, state, and local laws and reflects diverse talent in its workforce.
Seniority, Employment Type & Job Function
Seniority level: Mid‑Senior level
Employment type: Full‑time
Job functions: Design, Art/Creative, and Information Technology
Industries: Business Consulting and Services
#J-18808-Ljbffr