Turing
Remote Senior Software Engineer (LLM) - 35501
Turing, Washington, District of Columbia, us, 20022
Remote Senior Software Engineer (LLM) - 35501
Remote Senior Software Engineer (LLM) - 35501
1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process. As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code. Key Responsibilities Review and compare 3–4 model-generated code responses for each task using a structured ranking framework Assess code changes (diffs) for correctness, quality, readability, and performance Provide clear, concise explanations for your ranking decisions Maintain consistency and fairness across all evaluations Identify and document edge cases or unusual model behavior Collaborate with the team to improve evaluation processes and identify improvement areas Required Qualifications Professional Experience Several years of total experience as a software engineer
(experience working as a data scientist will not be considered) Minimum 2 years of experience as a full-stack engineer at a leading tech product company (e.g., Google, Shopify, Microsoft, Snowflake, Meta, PayPal, etc.) Note: Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies. Technical Skills Strong understanding of software design, debugging, and engineering best practices Familiarity with code review processes and version control systems Ability to analyze and compare real-world code changes Excellent written communication skills for clearly explaining technical evaluations Preferred Qualifications Degree from a top-ranked university is preferred but not required Experience working with LLM-generated code or AI evaluation projects Background in developer tools or systems automation Exposure to AI research or developer agents Type: Contract (no medical benefits or paid leave) Commitment: 10–20 hours/week, with flexible work hours (partial overlap with Pacific Time) Duration: 1 month (starting next week, with potential for extension) Compensation: $50–$150/hour, based on experience, geography, and skill level About Turing: Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI. If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Contract Job function
Job function Information Technology and Engineering Industries Software Development Referrals increase your chances of interviewing at Turing by 2x Get notified about new Software Engineer jobs in
Washington, United States . Seattle, WA $100,000.00-$720,000.00 1 week ago Seattle, WA $90,000.00-$180,000.00 2 weeks ago Seattle, WA $130,000.00-$200,000.00 2 weeks ago Seattle, WA $150,000.00-$180,000.00 3 weeks ago Seattle, WA $150,000.00-$175,000.00 3 months ago Software Engineer - AI/ML, Multiple Locations
Redmond, WA $84,200.00-$180,400.00 3 days ago Seattle, WA $90,000.00-$130,000.00 3 weeks ago Pasco, WA $90,000.00-$120,000.00 2 days ago Greater Seattle Area $176,000.00-$210,000.00 2 weeks ago Software Engineer, Notifications Platform
Seattle, WA $162,000.00-$180,000.00 2 weeks ago Machine Learning Engineer, Core Engineering
Full Stack Developer - Fully Remote JN -082025-163986
Seattle, WA $110,000.00-$140,000.00 2 months ago Bellevue, WA $140,000.00-$185,000.00 1 week ago Seattle, WA $185,000.00-$245,000.00 2 weeks ago Senior Software Engineer, Backend - Fintech
Seattle, WA $150,000.00-$350,000.00 1 week ago Software Engineer - Security, Multiple Locations
United States $84,200.00-$180,400.00 4 days ago Senior Web Developer - Full Stack (remote)
Seattle, WA $62,400.00-$104,000.00 2 weeks ago Software Engineer - Systems, Multiple Locations
Redmond, WA $84,200.00-$180,400.00 1 day ago Software Engineer, Person to Person (P2P) Payments
Seattle, WA $150,000.00-$180,000.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Remote Senior Software Engineer (LLM) - 35501
1 day ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. We are developing high-quality training and evaluation datasets to improve how Large Language Models (LLMs) perform on real software engineering problems. The core of this project involves identifying and curating verifiable coding tasks from public GitHub repositories, supported by a human-in-the-loop review process. As a contractor on this project, you will review code written by AI to solve real software tasks. Your feedback will help improve how future AI models learn to write and understand code. Key Responsibilities Review and compare 3–4 model-generated code responses for each task using a structured ranking framework Assess code changes (diffs) for correctness, quality, readability, and performance Provide clear, concise explanations for your ranking decisions Maintain consistency and fairness across all evaluations Identify and document edge cases or unusual model behavior Collaborate with the team to improve evaluation processes and identify improvement areas Required Qualifications Professional Experience Several years of total experience as a software engineer
(experience working as a data scientist will not be considered) Minimum 2 years of experience as a full-stack engineer at a leading tech product company (e.g., Google, Shopify, Microsoft, Snowflake, Meta, PayPal, etc.) Note: Experience from contractual or part-time roles will not be considered. Only full-time employment qualifies. Technical Skills Strong understanding of software design, debugging, and engineering best practices Familiarity with code review processes and version control systems Ability to analyze and compare real-world code changes Excellent written communication skills for clearly explaining technical evaluations Preferred Qualifications Degree from a top-ranked university is preferred but not required Experience working with LLM-generated code or AI evaluation projects Background in developer tools or systems automation Exposure to AI research or developer agents Type: Contract (no medical benefits or paid leave) Commitment: 10–20 hours/week, with flexible work hours (partial overlap with Pacific Time) Duration: 1 month (starting next week, with potential for extension) Compensation: $50–$150/hour, based on experience, geography, and skill level About Turing: Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI. If you have strong software engineering expertise and are interested in helping shape the next generation of AI-assisted development tools, we encourage you to apply. Seniority level
Seniority level Mid-Senior level Employment type
Employment type Contract Job function
Job function Information Technology and Engineering Industries Software Development Referrals increase your chances of interviewing at Turing by 2x Get notified about new Software Engineer jobs in
Washington, United States . Seattle, WA $100,000.00-$720,000.00 1 week ago Seattle, WA $90,000.00-$180,000.00 2 weeks ago Seattle, WA $130,000.00-$200,000.00 2 weeks ago Seattle, WA $150,000.00-$180,000.00 3 weeks ago Seattle, WA $150,000.00-$175,000.00 3 months ago Software Engineer - AI/ML, Multiple Locations
Redmond, WA $84,200.00-$180,400.00 3 days ago Seattle, WA $90,000.00-$130,000.00 3 weeks ago Pasco, WA $90,000.00-$120,000.00 2 days ago Greater Seattle Area $176,000.00-$210,000.00 2 weeks ago Software Engineer, Notifications Platform
Seattle, WA $162,000.00-$180,000.00 2 weeks ago Machine Learning Engineer, Core Engineering
Full Stack Developer - Fully Remote JN -082025-163986
Seattle, WA $110,000.00-$140,000.00 2 months ago Bellevue, WA $140,000.00-$185,000.00 1 week ago Seattle, WA $185,000.00-$245,000.00 2 weeks ago Senior Software Engineer, Backend - Fintech
Seattle, WA $150,000.00-$350,000.00 1 week ago Software Engineer - Security, Multiple Locations
United States $84,200.00-$180,400.00 4 days ago Senior Web Developer - Full Stack (remote)
Seattle, WA $62,400.00-$104,000.00 2 weeks ago Software Engineer - Systems, Multiple Locations
Redmond, WA $84,200.00-$180,400.00 1 day ago Software Engineer, Person to Person (P2P) Payments
Seattle, WA $150,000.00-$180,000.00 1 month ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr