Logo
Anthropic

Data Operations Manager, Knowledge

Anthropic, San Francisco, California, United States, 94199

Save Job

Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the Role Anthropic is seeking an entrepreneurial Data Operations Manager to spearhead human data collection initiatives that directly power Claude's most advanced capabilities. You'll work across our Claude Skills, Knowledge, Safeguards, and Frontier Red Team to design, build, and scale complex data collection projects that push the boundaries of AI safety and capability research. This is a highly strategic, 0-to-1 role designed for someone with startup founder mentality and operational excellence - think technical product manager or early-stage startup operator who thrives at the intersection of cutting-edge AI research and scalable execution. You'll create novel data collection methodologies, build processes from scratch, and solve complex challenges that directly improve Claude's reasoning, safety, and knowledge capabilities. You will own "data as the product" for our most critical AI research initiatives, translating breakthrough research ideas into robust, scalable data collection systems that enable frontier model development while maintaining our commitment to safety and alignment. About the Impact As our Data Operations Manager, you'll be at the forefront of developing the data infrastructure that enables breakthrough advances in AI capabilities while ensuring safety and alignment. Your work will directly contribute to making AI systems more capable at complex reasoning and knowledge tasks while maintaining our commitment to beneficial AI development. If you're excited about building something entirely new, have the technical intuition to understand complex AI systems, and possess the entrepreneurial drive to create scalable operations from the ground up, we'd love to hear from you. Responsibilities Strategic Leadership & Vision Lead comprehensive data strategies for Claude Skills, Safety evaluations, and frontier capability assessment that directly impact model performance and safety Drive strategic initiatives affecting data quality, operational efficiency, and research velocity across multiple teams Collaborate with research leaders to understand complex technical requirements and translate them into scalable operational frameworks Technical Infrastructure & Innovation Design and build novel data collection systems and evaluation frameworks that enable rigorous measurement of AI capabilities and safety properties Architect scalable, automated infrastructure for collecting, processing, and managing high-quality human feedback data Develop sophisticated tooling and platforms that support complex human-AI interaction scenarios for knowledge tasks and safety evaluations Cross-functional Partnership & Project Management Partner with researchers, engineers, and product teams to scope complex projects, resolve technical blockers, and ensure seamless integration with training pipelines Manage multiple complex, high-stakes projects simultaneously, balancing technical complexity with delivery timelines Create analytics and measurement frameworks to make data-driven decisions about project prioritization and resource allocation Operational Excellence & Scaling Build and manage relationships with specialized contractors and vendors for highly technical data collection requirements Implement robust quality control and verification processes to ensure data usability for training state-of-the-art AI systems Establish processes that enable rapid iteration and experimentation while maintaining rigorous quality standards for safety-critical applications You may be a good fit if you Have 5+ years of experience in technical operations, product management, or similar roles with a proven track record of building complex systems from the ground up Demonstrate entrepreneurial experience as a technical founder, early-stage startup operator, or in similar 0-to-1 leadership roles where you've built both processes and products Have strong technical intuition for what makes high-quality training data for advanced AI systems and experience with AI systems, large language models, or evaluation frameworks Possess exceptional project management skills with ability to coordinate complex technical initiatives across multiple teams Are comfortable operating in highly ambiguous environments where you need to define both the "what" and the "how" from scratch Have a strong product mindset for understanding user needs and translating them into operational requirements Thrive in fast-paced research environments with shifting priorities and novel technical challenges Are passionate about AI safety and understand the critical importance of high-quality data in building beneficial AI systems Strong candidates may also have Experience building or working with AI agents, evaluation systems, or advanced AI safety methodologies Background in designing and implementing evaluation systems or human-in-the-loop workflows for large language models Experience with agentic AI systems, computer use capabilities, or advanced reasoning assistance tools Knowledge of AI safety evaluation, red teaming, constitutional AI, or related AI safety methodologies Background in human-computer interaction (HCI), user experience design, or related fields with focus on optimizing human-AI collaboration Experience in high-growth startup environments, particularly in technical roles that evolved to include operational responsibilities Background collaborating with AI researchers or experience in research-oriented organizations Technical expertise in areas like data pipelines, evaluation frameworks, or ML infrastructure Role Specific Location Policy: This role is based in San Francisco office; however, we are open to considering exceptional candidates for remote work on a case-by-case basis. The expected salary range for this position is: $270,000 - $290,000 USD Logistics Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience. Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices. Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this. We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed. Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team. How we're different We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact - advancing our long-term goals of steerable, trustworthy AI - rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills. The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences. Come work with us! Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Apply for this job * indicates a required field First Name * Last Name * Email * Phone Resume/CV Enter manually Accepted file types: pdf, doc, docx, txt, rtf AI Policy for Application * Select... While we encourage people to use AI systems during their role to help them work faster and more effectively, please do not use AI assistants during the application process. We want to understand your personal interest in Anthropic without mediation through an AI system, and we also want to evaluate your non-AI-assisted communication skills. Please indicate 'Yes' if you have read and agree. Why Anthropic? * Why do you want to work at Anthropic? (We value this response highly - great answers are often 200-400 words.) Do you have experience with human data labeling operations? If so, please describe your experience and any key projects or outcomes. Highlight if your data labeling was for large language models or some other application. * Have you managed vendor contracts, external contractors, or data labeling teams? Please provide details on the size of the teams/working model (full-time, part-time, contractor, vendor) and your specific responsibilities. * Have you managed vendor contracts, external contractors, or data labeling teams? Please provide details on the size of the teams/working model (full-time, part-time, contractor, vendor) and your specific responsibilities. In your previous roles, who were your key stakeholders and how did you effectively partner with them to achieve project goals? * Website Publications (e.g. Google Scholar) URL (Optional) Personal Preferences How do you pronounce your name? When is the earliest you would want to start working with us? Do you have any deadlines or timeline considerations we should be aware of? Will you now or in the future require visa sponsorship for employment at Anthropic? * Select... Are you legally authorized to work in the country in which the job you are applying for is located? * Select... Additional Information Add a cover letter or anything else you want to share. LinkedIn Profile Please ensure to provide either your LinkedIn profile or Resume, we require at least one of the two. Are you open to relocation for this role? * Select... What is the address from which you plan on working? And if you would need to relocate, please type "relocating". * There is slight preference for this person to be based out of our San Francisco or New York office. Are you open to working in-person in one of our offices 25% of the time? * Select... Have you ever interviewed at Anthropic before? * Select... Do you require visa sponsorship? * Select... Voluntary Self-Identification For government reporting purposes, we ask candidates to respond to the below self-identification pletion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file. As set forth in Anthropic's Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law. If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows: A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability. A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service. An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense. An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985. Select... Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Voluntary Self-Identification of Disability Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026 Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years. Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor's Office of Federal Contract Compliance Programs (OFCCP) website at . How do you know if you have a disability? A disability is a condition that substantially limits one or more of your major life activities. If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to: Alcohol or other substance use disorder (not currently using drugs illegally) Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS Blind or low vision Cancer (past or present) Cardiovascular or heart disease Celiac disease Cerebral palsy Deaf or serious difficulty hearing Diabetes Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders Epilepsy or other seizure disorder Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome Intellectual or developmental disability Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD Missing limbs or partially missing limbs Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports Nervous system condition, for example, migraine headaches, Parkinson's disease, multiple sclerosis (MS) Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities Partial or complete paralysis (any cause) Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema Short stature (dwarfism) Traumatic brain injury Disability Status Select... PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete. #J-18808-Ljbffr