Capital One
Senior Manager, Data Science - LLM Customization Team
Capital One, New York, New York, us, 10261
Overview
Senior Manager, Data Science - LLM Customization Team at Capital One. AI is transforming every industry, and Capital One aims to shape how it transforms financial services by leveraging state-of-the-art AI and generative technologies. Team Description
AI Foundations LLM Customization team is central to bringing our vision for LLMs and GenAI to life. We work across the research lifecycle, from research to production systems, collaborating with product, technology, and business leaders to apply leading-edge AI to our business. You will drive experimentation, innovation, and the creation of next-generation experiences powered by emerging generative AI technologies. In this role, you will
Partner with a cross-functional team of data scientists, applied researchers, software engineers, machine learning engineers, and product managers to deliver AI-powered products that change how customers interact with their money. Leverage a broad stack of technologies—PyTorch, Hugging Face, AWS Ultraclusters, LangChain, VectorDBs, and more—to reveal insights hidden within large volumes of numeric and textual data. Be the NLP expert to harness the power of Large Language Models (LLMs), adapt and finetune them for business-specific applications and features. Build NLP models through all phases of development—from design to training, evaluation, and validation—collaborating with engineering teams to operationalize them in scalable, resilient production systems. Translate the complexity of your work into tangible business goals using strong interpersonal and communication skills. The Ideal Candidate is
Innovative – continually researches and evaluates emerging technologies and stays current on state-of-the-art methods, technologies, and applications, seeking opportunities to apply them. Creative – thrives on defining big, undefined problems, asks questions, and shares new ideas. Technical – comfortable with advanced ML/DL technologies including language models, hands-on experience with LLMs and open-source tools and cloud platforms. Influential – passionate about AI/ML and able to lead cross-functional teams in breakthrough innovations; communicates findings clearly to non-technical audiences. Experienced in training language models or large computer vision models with expertise in topics such as training optimization, self-supervised learning, explainability, and RLHF. Engineering-minded with a track record of delivering models at scale, and delivering libraries, platforms, or solution-level code to existing products. Basic Qualifications
Currently has, or is in the process of obtaining, one of the following with the expectation that the degree will be obtained by the start date:
A Bachelor's Degree in a quantitative field plus 7 years of data analytics experience. A Master's Degree in a quantitative field or an MBA with a quantitative concentration plus 5 years of data analytics experience. A PhD in a quantitative field plus 2 years of data analytics experience.
At least 2 years of experience leveraging open source programming languages for large-scale data analysis. At least 2 years of experience working with machine learning. At least 2 years of experience utilizing relational databases. Preferred Qualifications
PhD in STEM fields plus 4 years of data analytics experience. At least 1 year of experience working with AWS. At least 1 year of experience managing people. At least 5 years of experience in Python, Scala, or R for large-scale data analysis. At least 5 years of experience with machine learning. Experience with LLMs and related topics, including: pre-training focus in NLP or Masters with industrial NLP research experience; publications on pre-training, SSL, or related topics; experience training a large language model from scratch; publications in deep learning theory; publications at ACL/NAACL/EMNLP, NeurIPS, ICML, or ICLR; and expertise in finetuning, guided LLMs, and model guidance. Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Salaries for part-time roles will be prorated based on hours worked. New York, NY: $245,900 - $280,600 for Sr Mgr, Data Science. Other locations follow their respective pay ranges as noted in the offer letter. This role is also eligible to earn performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI). Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full/part-time status, exempt/non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) and participates in federal, state, and local equal employment opportunity laws. Capital One maintains a drug-free workplace and will consider qualified applicants with criminal histories in accordance with applicable laws and regulations. If you require an accommodation during the application process, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. For technical support or questions about Capital One's recruiting process, please email Careers@capitalone.com. Capital One does not provide, endorse, or guarantee third-party products or information available through this site. Capital One Financial is made up of several entities. Positions posted in Canada, the United Kingdom, or the Philippines are for the respective Capital One entities in those regions.
#J-18808-Ljbffr
Senior Manager, Data Science - LLM Customization Team at Capital One. AI is transforming every industry, and Capital One aims to shape how it transforms financial services by leveraging state-of-the-art AI and generative technologies. Team Description
AI Foundations LLM Customization team is central to bringing our vision for LLMs and GenAI to life. We work across the research lifecycle, from research to production systems, collaborating with product, technology, and business leaders to apply leading-edge AI to our business. You will drive experimentation, innovation, and the creation of next-generation experiences powered by emerging generative AI technologies. In this role, you will
Partner with a cross-functional team of data scientists, applied researchers, software engineers, machine learning engineers, and product managers to deliver AI-powered products that change how customers interact with their money. Leverage a broad stack of technologies—PyTorch, Hugging Face, AWS Ultraclusters, LangChain, VectorDBs, and more—to reveal insights hidden within large volumes of numeric and textual data. Be the NLP expert to harness the power of Large Language Models (LLMs), adapt and finetune them for business-specific applications and features. Build NLP models through all phases of development—from design to training, evaluation, and validation—collaborating with engineering teams to operationalize them in scalable, resilient production systems. Translate the complexity of your work into tangible business goals using strong interpersonal and communication skills. The Ideal Candidate is
Innovative – continually researches and evaluates emerging technologies and stays current on state-of-the-art methods, technologies, and applications, seeking opportunities to apply them. Creative – thrives on defining big, undefined problems, asks questions, and shares new ideas. Technical – comfortable with advanced ML/DL technologies including language models, hands-on experience with LLMs and open-source tools and cloud platforms. Influential – passionate about AI/ML and able to lead cross-functional teams in breakthrough innovations; communicates findings clearly to non-technical audiences. Experienced in training language models or large computer vision models with expertise in topics such as training optimization, self-supervised learning, explainability, and RLHF. Engineering-minded with a track record of delivering models at scale, and delivering libraries, platforms, or solution-level code to existing products. Basic Qualifications
Currently has, or is in the process of obtaining, one of the following with the expectation that the degree will be obtained by the start date:
A Bachelor's Degree in a quantitative field plus 7 years of data analytics experience. A Master's Degree in a quantitative field or an MBA with a quantitative concentration plus 5 years of data analytics experience. A PhD in a quantitative field plus 2 years of data analytics experience.
At least 2 years of experience leveraging open source programming languages for large-scale data analysis. At least 2 years of experience working with machine learning. At least 2 years of experience utilizing relational databases. Preferred Qualifications
PhD in STEM fields plus 4 years of data analytics experience. At least 1 year of experience working with AWS. At least 1 year of experience managing people. At least 5 years of experience in Python, Scala, or R for large-scale data analysis. At least 5 years of experience with machine learning. Experience with LLMs and related topics, including: pre-training focus in NLP or Masters with industrial NLP research experience; publications on pre-training, SSL, or related topics; experience training a large language model from scratch; publications in deep learning theory; publications at ACL/NAACL/EMNLP, NeurIPS, ICML, or ICLR; and expertise in finetuning, guided LLMs, and model guidance. Capital One will consider sponsoring a new qualified applicant for employment authorization for this position. The minimum and maximum full-time annual salaries for this role are listed below, by location. Salaries for part-time roles will be prorated based on hours worked. New York, NY: $245,900 - $280,600 for Sr Mgr, Data Science. Other locations follow their respective pay ranges as noted in the offer letter. This role is also eligible to earn performance-based incentive compensation, which may include cash bonuses and/or long-term incentives (LTI). Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support total well-being. Learn more at the Capital One Careers website. Eligibility varies based on full/part-time status, exempt/non-exempt status, and management level. This role is expected to accept applications for a minimum of 5 business days. No agencies please. Capital One is an equal opportunity employer (EOE, including disability/vet) and participates in federal, state, and local equal employment opportunity laws. Capital One maintains a drug-free workplace and will consider qualified applicants with criminal histories in accordance with applicable laws and regulations. If you require an accommodation during the application process, please contact Capital One Recruiting at 1-800-304-9102 or via email at RecruitingAccommodation@capitalone.com. For technical support or questions about Capital One's recruiting process, please email Careers@capitalone.com. Capital One does not provide, endorse, or guarantee third-party products or information available through this site. Capital One Financial is made up of several entities. Positions posted in Canada, the United Kingdom, or the Philippines are for the respective Capital One entities in those regions.
#J-18808-Ljbffr