Get AI-powered advice on this job and more exclusive features.
Primary Skills: Risk Assessment-Expert, Safety Testing-Advanced, Prompt Engineering-Intermediate, Red Teaming-Expert, LLM Safety Risk-High
Contract Type: W2
Duration: 3 - 6 Months
Location: Palo Alto, CA - 94306 ( - Remote)
Pay Range: $70.42 - $80.42 per hour on W2
#LP
Job Summary
This role involves creating and executing safety testing strategies for LLM-based features, evaluating test results for comprehensive risk assessment, and documenting findings accurately to ensure improvements in system safety and user trust. The successful candidate will work closely with cross-functional teams to identify potential misuses, refine testing processes, and provide actionable insights for enhancing safety protocols in AI systems. Prior experience in a similar role, particularly within Trust & Safety, QA, or adversarial testing, and a strong understanding of AI system risks and mitigation strategies are essential.
Key Responsibilities
- Create and execute comprehensive safety testing plans for LLM-based features.
- Evaluate and analyze testing outcomes for risk assessment and propose mitigation actions.
- Document testing strategies, results, and actionable feedback meticulously.
- Maintain effective communication with internal stakeholders to align on safety standards and improvements.
- Proactively identify and suggest enhancements to the red teaming and testing processes.
- Advanced understanding of LLM safety risks and mitigation strategies.
- Proven ability to apply an adversarial mindset to identify potential system misuses.
- Strong documentation and organizational skills to accurately track and report findings.
- Experience in AI, Trust & Safety, or product QA highly preferred.
- Background in Engineering, Computer Science, Data Science, or Information Systems is required.
Akraya is an award-winning IT staffing firm consistently recognized for our commitment to excellence and a thriving work environment . Most recently, we were recognized Inc's Best Workplaces 2024 and Silicon Valley's Best Places to Work by the San Francisco Business Journal (2024) and Glassdoor's Best Places to Work (2023 & 2022)!
Industry Leaders in IT Staffing
As staffing solutions providers for Fortune 100 companies, Akraya's industry recognitions solidify our leadership position in the IT staffing space. We don't just connect you with great jobs, we connect you with a workplace that inspires!
Join Akraya Today!
Let us lead you to your dream career and experience the Akraya difference. Browse our open positions and join our team!
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Contract
Job function
Job function
Information TechnologyIndustries
Staffing and Recruiting
Referrals increase your chances of interviewing at Akraya, Inc. by 2x
Sign in to set job alerts for “Data Analyst” roles.
Mountain View, CA $95,000.00-$110,000.00 1 week ago
Business Intelligence Analyst, Growth Marketing
Sunnyvale, CA $114,000.00-$163,000.00 1 week ago
Mountain View, CA $80.00-$85.00 1 week ago
Redwood City, CA $101,700.00-$140,700.00 1 week ago
Mountain View, CA $48.00-$58.90 3 days ago
Data Analyst - People Analytics (Short-Term Employment)
Foster City, CA $117,600.00-$166,150.00 3 days ago
Mountain View, CA $48.00-$58.90 2 weeks ago
San Jose, CA $44,000.00-$130,000.00 2 days ago
San Jose, CA $106,400.00-$177,777.00 2 days ago
Mountain View, CA $110,000.00-$125,000.00 1 week ago
San Jose, CA $175,000.00-$200,000.00 1 week ago
San Jose, CA $70,000.00-$119,000.00 3 days ago
Dublin, CA $77,900.00-$117,050.00 3 weeks ago
San Jose, CA $76,500.00-$126,500.00 2 weeks ago
Data Management Analyst (Short Term Employee)
Menlo Park, CA $124,000.00-$176,000.00 3 weeks ago
Mountain View, CA $60.00-$68.00 1 week ago
Fremont, CA $122,000.00-$177,000.00 1 week ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr