IRONCLAD COMPANY
AI Data Scientist, Evaluation & Insights
Join to apply for the
AI Data Scientist, Evaluation & Insights
role at
Ironclad AI Data Scientist, Evaluation & Insights
Join to apply for the
AI Data Scientist, Evaluation & Insights
role at
Ironclad Ironclad is the leading AI-powered contract lifecycle management platform, processing billions of contracts every year.
Every business is powered by contracts, but managing them can slow companies down and cost millions of dollars. Global innovators like LOral, OpenAI, and Salesforce trust Ironclad to transform contracting into a strategic advantage - accelerating revenue, reducing risk, and driving efficiency. Its the only platform that manages every type of contract workflow, whether a sales agreement, an HR agreement or a complex NDA.
Were building the future of intelligent contracting and writing the narrative for how contracts unlock strategic growth.
Forrester Wave
and
Gartner Magic Quadrant
have consistently recognized Ironclad as a leader in our category. Weve also been named one of
Fortunes Great Places to Work
six years running, featured on
Glassdoors Best Places to Work , and recognized by
Forbes 50 Most Promising AI Companies .
Were backed by leading investors like Accel, Sequoia, Y Combinator, and BOND. Wed love for you to join us!
About The Role
Ironclad is accelerating its investment in AI to redefine how legal teams manage and understand contracts. As part of this effort, we are hiring an AI Evaluation Engineer to work within our AI Pillar. This role is focused on unlocking insights from our training data, designing feedback loops, and ensuring the continuous improvement of our agentic and ML or LLM-based systems through data-driven evaluation and iteration.
Youll partner closely with AI Engineers and Product Managers to drive better model quality through systematic analysis, experimentation, and the curation of high-leverage datasets. Your work will directly impact the effectiveness of features like Smart Import, contract understanding, and agentic workflows.
What You'll Be Doing
Analyze training and evaluation datasets to identify distributional gaps, labeling inconsistencies, and long-tail opportunities. Design and execute labeling campaigns, including development of golden datasets and annotation guidelines. Build and maintain dashboards that track model accuracy, regression trends, and product-specific KPIs like success rate or answer helpfulness. Investigate failure modes via prompt clustering, error taxonomy development, and user intent classification. Operationalize feedback loops: mine product telemetry and human-in-the-loop reviews for signal, then translate into data-driven model improvement strategies. Partner with engineers and PMs to run structured A/B tests and human evaluations for new models or features. Support the development of scalable data and evaluation infrastructure for LLMs and agents. Work with product, engineering and legal to create clear & transparent processes for the handling of customer data in AI training, fine-tuning and evaluation
About You
Bachelor's or Master's degree in a quantitative field (e.g., Statistics, Computer Science, Data Science, Applied Math). 13 years of experience in applied ML or data science, preferably in NLP or LLM-based applications. Strong SQL and Python skills; experience with Jupyter, Pandas, and experiment tracking tools. Comfortable navigating ambiguity, slicing large datasets, and communicating insights clearly to cross-functional stakeholders. Experience with prompt analysis, clustering, or user behavior modeling is a plus. Bonus: familiarity with LLM eval techniques, Reinforcement Learning from Human Feedback (RLHF), or agentic system design.Experience with program management.
Why This Role Matters
AI is critical to the value Ironclad customers get from their contracts, allowing their business to manage risk, close revenue faster and operate more effectively. None of this is possible without reliable and accurate data. This role will lead these efforts, becoming a key contributor to the development of AI solutions in an industry that is likely to be transformed by the new generation of models.
What We Value
Bias for action and data curiosity Ownership mindset and team-first attitude Comfort in fast-paced, iterative environments Passion for building AI products that solve real-world customer problems
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Compensation Range: $125K - $170K
Seniority level
Seniority level
Entry level Employment type
Employment type
Full-time Job function
Industries
Technology, Information and Internet Referrals increase your chances of interviewing at Ironclad by 2x Get notified about new Data Scientist jobs in
Seattle, WA . Seattle, WA $158,200.00-$185,000.00 2 days ago Redmond, WA $114,000.00-$171,000.00 6 days ago Bellevue, WA $114,000.00-$171,000.00 1 week ago Seattle, WA $114,000.00-$171,000.00 1 week ago Redmond, WA $119,800.00-$258,000.00 1 week ago Seattle, WA $109,000.00-$192,400.00 1 week ago Bellevue, WA $145,000.00-$204,000.00 2 hours ago Bellevue, WA $145,000.00-$204,000.00 6 days ago Seattle, WA $173,000.00-$242,000.00 1 week ago Bellevue, WA $173,000.00-$242,000.00 1 week ago Seattle, WA $100,000.00-$220,000.00 4 months ago Seattle, WA $145,000.00-$204,000.00 1 week ago Redmond, WA $145,000.00-$204,000.00 1 week ago Machine Learning Engineer Graduate (TikTok E-Commerce - Conversational AI) -2025 Start (BS/MS)
Seattle, WA $104,500.00-$139,650.00 2 days ago Seattle, WA $99,500.00-$187,000.00 2 weeks ago Seattle, WA $160,000.00-$180,000.00 2 weeks ago Seattle, WA $110,000.00-$160,000.00 6 days ago Seattle, WA $140,000.00-$180,000.00 20 hours ago Seattle, WA $140,000.00-$220,000.00 5 days ago Redmond, WA $119,800.00-$258,000.00 1 week ago Redmond, WA $100,600.00-$215,400.00 1 week ago Seattle, WA $130,000.00-$290,000.00 1 day ago Machine Learning Engineer, AI (FULLY REMOTE)
Seattle, WA $176,600.00-$225,900.00 6 days ago Machine Learning Engineer Graduate Data-Search - TikTok.US - San Jose) - 2025 Start (BS/MS)
Seattle, WA $106,400.00-$168,150.00 4 days ago Seattle, WA $143,000.00-$312,800.00 3 weeks ago Software Developer-Artificial Intelligent/Machine Learning
Seattle, WA $118,658.00-$168,150.00 4 days ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Join to apply for the
AI Data Scientist, Evaluation & Insights
role at
Ironclad AI Data Scientist, Evaluation & Insights
Join to apply for the
AI Data Scientist, Evaluation & Insights
role at
Ironclad Ironclad is the leading AI-powered contract lifecycle management platform, processing billions of contracts every year.
Every business is powered by contracts, but managing them can slow companies down and cost millions of dollars. Global innovators like LOral, OpenAI, and Salesforce trust Ironclad to transform contracting into a strategic advantage - accelerating revenue, reducing risk, and driving efficiency. Its the only platform that manages every type of contract workflow, whether a sales agreement, an HR agreement or a complex NDA.
Were building the future of intelligent contracting and writing the narrative for how contracts unlock strategic growth.
Forrester Wave
and
Gartner Magic Quadrant
have consistently recognized Ironclad as a leader in our category. Weve also been named one of
Fortunes Great Places to Work
six years running, featured on
Glassdoors Best Places to Work , and recognized by
Forbes 50 Most Promising AI Companies .
Were backed by leading investors like Accel, Sequoia, Y Combinator, and BOND. Wed love for you to join us!
About The Role
Ironclad is accelerating its investment in AI to redefine how legal teams manage and understand contracts. As part of this effort, we are hiring an AI Evaluation Engineer to work within our AI Pillar. This role is focused on unlocking insights from our training data, designing feedback loops, and ensuring the continuous improvement of our agentic and ML or LLM-based systems through data-driven evaluation and iteration.
Youll partner closely with AI Engineers and Product Managers to drive better model quality through systematic analysis, experimentation, and the curation of high-leverage datasets. Your work will directly impact the effectiveness of features like Smart Import, contract understanding, and agentic workflows.
What You'll Be Doing
Analyze training and evaluation datasets to identify distributional gaps, labeling inconsistencies, and long-tail opportunities. Design and execute labeling campaigns, including development of golden datasets and annotation guidelines. Build and maintain dashboards that track model accuracy, regression trends, and product-specific KPIs like success rate or answer helpfulness. Investigate failure modes via prompt clustering, error taxonomy development, and user intent classification. Operationalize feedback loops: mine product telemetry and human-in-the-loop reviews for signal, then translate into data-driven model improvement strategies. Partner with engineers and PMs to run structured A/B tests and human evaluations for new models or features. Support the development of scalable data and evaluation infrastructure for LLMs and agents. Work with product, engineering and legal to create clear & transparent processes for the handling of customer data in AI training, fine-tuning and evaluation
About You
Bachelor's or Master's degree in a quantitative field (e.g., Statistics, Computer Science, Data Science, Applied Math). 13 years of experience in applied ML or data science, preferably in NLP or LLM-based applications. Strong SQL and Python skills; experience with Jupyter, Pandas, and experiment tracking tools. Comfortable navigating ambiguity, slicing large datasets, and communicating insights clearly to cross-functional stakeholders. Experience with prompt analysis, clustering, or user behavior modeling is a plus. Bonus: familiarity with LLM eval techniques, Reinforcement Learning from Human Feedback (RLHF), or agentic system design.Experience with program management.
Why This Role Matters
AI is critical to the value Ironclad customers get from their contracts, allowing their business to manage risk, close revenue faster and operate more effectively. None of this is possible without reliable and accurate data. This role will lead these efforts, becoming a key contributor to the development of AI solutions in an industry that is likely to be transformed by the new generation of models.
What We Value
Bias for action and data curiosity Ownership mindset and team-first attitude Comfort in fast-paced, iterative environments Passion for building AI products that solve real-world customer problems
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Compensation Range: $125K - $170K
Seniority level
Seniority level
Entry level Employment type
Employment type
Full-time Job function
Industries
Technology, Information and Internet Referrals increase your chances of interviewing at Ironclad by 2x Get notified about new Data Scientist jobs in
Seattle, WA . Seattle, WA $158,200.00-$185,000.00 2 days ago Redmond, WA $114,000.00-$171,000.00 6 days ago Bellevue, WA $114,000.00-$171,000.00 1 week ago Seattle, WA $114,000.00-$171,000.00 1 week ago Redmond, WA $119,800.00-$258,000.00 1 week ago Seattle, WA $109,000.00-$192,400.00 1 week ago Bellevue, WA $145,000.00-$204,000.00 2 hours ago Bellevue, WA $145,000.00-$204,000.00 6 days ago Seattle, WA $173,000.00-$242,000.00 1 week ago Bellevue, WA $173,000.00-$242,000.00 1 week ago Seattle, WA $100,000.00-$220,000.00 4 months ago Seattle, WA $145,000.00-$204,000.00 1 week ago Redmond, WA $145,000.00-$204,000.00 1 week ago Machine Learning Engineer Graduate (TikTok E-Commerce - Conversational AI) -2025 Start (BS/MS)
Seattle, WA $104,500.00-$139,650.00 2 days ago Seattle, WA $99,500.00-$187,000.00 2 weeks ago Seattle, WA $160,000.00-$180,000.00 2 weeks ago Seattle, WA $110,000.00-$160,000.00 6 days ago Seattle, WA $140,000.00-$180,000.00 20 hours ago Seattle, WA $140,000.00-$220,000.00 5 days ago Redmond, WA $119,800.00-$258,000.00 1 week ago Redmond, WA $100,600.00-$215,400.00 1 week ago Seattle, WA $130,000.00-$290,000.00 1 day ago Machine Learning Engineer, AI (FULLY REMOTE)
Seattle, WA $176,600.00-$225,900.00 6 days ago Machine Learning Engineer Graduate Data-Search - TikTok.US - San Jose) - 2025 Start (BS/MS)
Seattle, WA $106,400.00-$168,150.00 4 days ago Seattle, WA $143,000.00-$312,800.00 3 weeks ago Software Developer-Artificial Intelligent/Machine Learning
Seattle, WA $118,658.00-$168,150.00 4 days ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr