Citi
Join to apply for the
Gen AI Solutions Product Architect -SVP
role at
Citi 1 day ago Be among the first 25 applicants Join to apply for the
Gen AI Solutions Product Architect -SVP
role at
Citi Get AI-powered advice on this job and more exclusive features. Role Overview:
As the Gen AI Solutions Product Architect, you will drive the development of a modular, reusable Gen AI product suite that enables cross-functional teams to deploy AI solutions rapidly without deep business context. You will architect "plug-and-play" Gen AI modules (e.g., RAG, prompt engineering, text-to-SQL) and foster an open-source-like community for contributions. This role demands a blend of product strategy, technical architecture, and cross-functional collaboration to ensure solutions are scalable, user-friendly, and aligned with enterprise needs. Role Overview:
As the Gen AI Solutions Product Architect, you will drive the development of a modular, reusable Gen AI product suite that enables cross-functional teams to deploy AI solutions rapidly without deep business context. You will architect "plug-and-play" Gen AI modules (e.g., RAG, prompt engineering, text-to-SQL) and foster an open-source-like community for contributions. This role demands a blend of product strategy, technical architecture, and cross-functional collaboration to ensure solutions are scalable, user-friendly, and aligned with enterprise needs.
Key Responsibilities
Product Roadmap & Modular Design Define the product vision and roadmap for reusable Gen AI modules (e.g., RAG, prompting frameworks, hybrid ML/LLM systems). Architect parameterized, business-agnostic solutions that abstract complexity (e.g., pre-configured prompts, vector DB connectors, chunking logic). Design APIs and microservices to expose modules as reusable components (e.g., “text-to-SQL service,” “RAG-as-a-service”). Technical Leadership Standardize patterns (e.g., prompt templates, chunking strategies, few-shot training pipelines) across use cases. Integrate LLM workflows (e.g., OpenAI, Claude) with traditional ML (clustering, classification) and enterprise systems (databases, UI tools). Optimize performance of Gen AI components (cost, latency, accuracy) and ensure scalability (e.g., load balancing for vector DBs). Cross-Functional Collaboration Partner with business teams to map their needs to pre-built modules (e.g., “Your compliance use case fits our RAG module with these parameters”). Build developer tools (SDKs, UI templates) to help teams self-serve (e.g., drag-and-drop prompt builders, vector DB configurators). Foster an open-source-like community: Create contribution guidelines, review external code, and incentivize modular feature additions. Adoption & Enablement Develop documentation, tutorials, and sandbox environments for testing modules. Train teams on best practices (e.g., prompt engineering, security for LLM outputs). Track metrics: Module reuse rate, contribution volume, time-to-deploy for new use cases.
Required Skills & Experience
Technical Expertise
Gen AI/ML Engineering: Hands-on experience with LLM integration (e.g., OpenAI, Anthropic, Llama 2) and frameworks (LangChain, LlamaIndex). Expertise in RAG workflows: Document chunking (sentence transformers), vector DBs (Pinecone, FAISS), and hybrid search. Familiarity with text-to-SQL systems, few-shot/chain-of-thought prompting, and traditional ML (clustering with scikit-learn, PyTorch). Software Engineering: Proficiency in Python, API design (FastAPI, Flask), and cloud platforms (AWS Sagemaker, Azure AI). Experience with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform). UI/Integration Skills: Frontend integration (React/Streamlit for config UIs) and middleware (message queues, auth systems like R2D2).
Product & Strategy
Proven track record of building reusable ML/API products or internal platforms. Ability to translate business problems into technical requirements (e.g., “Compliance needs a RAG module with PII redaction”). Agile/Scrum methodology and tools (Jira, GitHub Issues).
Soft Skills
Strong communication to bridge technical and non-technical stakeholders. Community-building skills to drive adoption and contributions. Pragmatic problem-solving (e.g., balancing customization vs. standardization).
Preferred Qualifications
Experience with open-source projects (contributor/maintainer). Knowledge of LLMOps tools (PromptLayer, Weights & Biases). Background in enterprise integration (SSO, RBAC, logging/monitoring).
Education:
Bachelor’s/University degree in Computer Science, Data Engineering, Cloud Computing, or a related field, or equivalent experience, potentially Master's degree/MBA
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Data Architecture
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Primary Location:
New York New York United States
------------------------------------------------------
Primary Location Full Time Salary Range:
$176,720.00 - $265,080.00
In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.
------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.
------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
Anticipated Posting Close Date:
Jul 01, 2025
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster. Seniority level
Seniority level Not Applicable Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries Banking, Financial Services, and Investment Banking Referrals increase your chances of interviewing at Citi by 2x Get notified about new Senior Product Architect jobs in
New York, NY . Solutions Architect (Hybrid - Flexible Options)
Newark, NJ $175,000.00-$200,000.00 5 days ago Solutions Architect - VP - New York (Hybrid)
New York, NY $142,320.00-$213,480.00 2 weeks ago CX Solutions Architect (Contact Center Ecosystems)
New York, NY $57,000.00-$190,000.00 5 days ago New York, NY $263,000.00-$288,000.00 1 week ago Solutions Architect/SME, Banking and Financial Services
Whippany, NJ $190,000.00-$210,000.00 4 days ago New York, NY $153,000.00-$221,500.00 6 days ago New York, NY $120,000.00-$190,000.00 8 months ago New York, NY $130,000.00-$140,000.00 1 week ago New York, NY $150,000.00-$200,000.00 6 months ago Solutions Architect, Enterprise (New York City)
New York, NY $162,000.00-$196,000.00 6 days ago New York City Metropolitan Area $170,000.00-$195,000.00 3 weeks ago Staff Solutions Architect - New Logo - New York
New York, NY $205,000.00-$258,000.00 2 weeks ago Solutions Architect - Functional Consultant
New York City Metropolitan Area 1 month ago New York, NY $72,000.00-$75,000.00 2 days ago GenAI Solutions Architect, Vice President
New York, NY $120,000.00-$200,000.00 2 weeks ago Solutions Architect, Retail, Google Cloud
New York, NY $147,000.00-$216,000.00 2 weeks ago Whippany, NJ $190,000.00-$210,000.00 4 days ago New York City Metropolitan Area 1 month ago Edison, NJ $150,000.00-$170,000.00 1 month ago New York, NY $160,000.00-$195,000.00 2 weeks ago Client Solutions Architect - Payments - Vice President
New York, NY $130,000.00-$250,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Gen AI Solutions Product Architect -SVP
role at
Citi 1 day ago Be among the first 25 applicants Join to apply for the
Gen AI Solutions Product Architect -SVP
role at
Citi Get AI-powered advice on this job and more exclusive features. Role Overview:
As the Gen AI Solutions Product Architect, you will drive the development of a modular, reusable Gen AI product suite that enables cross-functional teams to deploy AI solutions rapidly without deep business context. You will architect "plug-and-play" Gen AI modules (e.g., RAG, prompt engineering, text-to-SQL) and foster an open-source-like community for contributions. This role demands a blend of product strategy, technical architecture, and cross-functional collaboration to ensure solutions are scalable, user-friendly, and aligned with enterprise needs. Role Overview:
As the Gen AI Solutions Product Architect, you will drive the development of a modular, reusable Gen AI product suite that enables cross-functional teams to deploy AI solutions rapidly without deep business context. You will architect "plug-and-play" Gen AI modules (e.g., RAG, prompt engineering, text-to-SQL) and foster an open-source-like community for contributions. This role demands a blend of product strategy, technical architecture, and cross-functional collaboration to ensure solutions are scalable, user-friendly, and aligned with enterprise needs.
Key Responsibilities
Product Roadmap & Modular Design Define the product vision and roadmap for reusable Gen AI modules (e.g., RAG, prompting frameworks, hybrid ML/LLM systems). Architect parameterized, business-agnostic solutions that abstract complexity (e.g., pre-configured prompts, vector DB connectors, chunking logic). Design APIs and microservices to expose modules as reusable components (e.g., “text-to-SQL service,” “RAG-as-a-service”). Technical Leadership Standardize patterns (e.g., prompt templates, chunking strategies, few-shot training pipelines) across use cases. Integrate LLM workflows (e.g., OpenAI, Claude) with traditional ML (clustering, classification) and enterprise systems (databases, UI tools). Optimize performance of Gen AI components (cost, latency, accuracy) and ensure scalability (e.g., load balancing for vector DBs). Cross-Functional Collaboration Partner with business teams to map their needs to pre-built modules (e.g., “Your compliance use case fits our RAG module with these parameters”). Build developer tools (SDKs, UI templates) to help teams self-serve (e.g., drag-and-drop prompt builders, vector DB configurators). Foster an open-source-like community: Create contribution guidelines, review external code, and incentivize modular feature additions. Adoption & Enablement Develop documentation, tutorials, and sandbox environments for testing modules. Train teams on best practices (e.g., prompt engineering, security for LLM outputs). Track metrics: Module reuse rate, contribution volume, time-to-deploy for new use cases.
Required Skills & Experience
Technical Expertise
Gen AI/ML Engineering: Hands-on experience with LLM integration (e.g., OpenAI, Anthropic, Llama 2) and frameworks (LangChain, LlamaIndex). Expertise in RAG workflows: Document chunking (sentence transformers), vector DBs (Pinecone, FAISS), and hybrid search. Familiarity with text-to-SQL systems, few-shot/chain-of-thought prompting, and traditional ML (clustering with scikit-learn, PyTorch). Software Engineering: Proficiency in Python, API design (FastAPI, Flask), and cloud platforms (AWS Sagemaker, Azure AI). Experience with CI/CD, containerization (Docker), and infrastructure-as-code (Terraform). UI/Integration Skills: Frontend integration (React/Streamlit for config UIs) and middleware (message queues, auth systems like R2D2).
Product & Strategy
Proven track record of building reusable ML/API products or internal platforms. Ability to translate business problems into technical requirements (e.g., “Compliance needs a RAG module with PII redaction”). Agile/Scrum methodology and tools (Jira, GitHub Issues).
Soft Skills
Strong communication to bridge technical and non-technical stakeholders. Community-building skills to drive adoption and contributions. Pragmatic problem-solving (e.g., balancing customization vs. standardization).
Preferred Qualifications
Experience with open-source projects (contributor/maintainer). Knowledge of LLMOps tools (PromptLayer, Weights & Biases). Background in enterprise integration (SSO, RBAC, logging/monitoring).
Education:
Bachelor’s/University degree in Computer Science, Data Engineering, Cloud Computing, or a related field, or equivalent experience, potentially Master's degree/MBA
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Data Architecture
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Primary Location:
New York New York United States
------------------------------------------------------
Primary Location Full Time Salary Range:
$176,720.00 - $265,080.00
In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.
------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.
------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
Anticipated Posting Close Date:
Jul 01, 2025
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster. Seniority level
Seniority level Not Applicable Employment type
Employment type Full-time Job function
Job function Engineering and Information Technology Industries Banking, Financial Services, and Investment Banking Referrals increase your chances of interviewing at Citi by 2x Get notified about new Senior Product Architect jobs in
New York, NY . Solutions Architect (Hybrid - Flexible Options)
Newark, NJ $175,000.00-$200,000.00 5 days ago Solutions Architect - VP - New York (Hybrid)
New York, NY $142,320.00-$213,480.00 2 weeks ago CX Solutions Architect (Contact Center Ecosystems)
New York, NY $57,000.00-$190,000.00 5 days ago New York, NY $263,000.00-$288,000.00 1 week ago Solutions Architect/SME, Banking and Financial Services
Whippany, NJ $190,000.00-$210,000.00 4 days ago New York, NY $153,000.00-$221,500.00 6 days ago New York, NY $120,000.00-$190,000.00 8 months ago New York, NY $130,000.00-$140,000.00 1 week ago New York, NY $150,000.00-$200,000.00 6 months ago Solutions Architect, Enterprise (New York City)
New York, NY $162,000.00-$196,000.00 6 days ago New York City Metropolitan Area $170,000.00-$195,000.00 3 weeks ago Staff Solutions Architect - New Logo - New York
New York, NY $205,000.00-$258,000.00 2 weeks ago Solutions Architect - Functional Consultant
New York City Metropolitan Area 1 month ago New York, NY $72,000.00-$75,000.00 2 days ago GenAI Solutions Architect, Vice President
New York, NY $120,000.00-$200,000.00 2 weeks ago Solutions Architect, Retail, Google Cloud
New York, NY $147,000.00-$216,000.00 2 weeks ago Whippany, NJ $190,000.00-$210,000.00 4 days ago New York City Metropolitan Area 1 month ago Edison, NJ $150,000.00-$170,000.00 1 month ago New York, NY $160,000.00-$195,000.00 2 weeks ago Client Solutions Architect - Payments - Vice President
New York, NY $130,000.00-$250,000.00 2 weeks ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr