AI Engineer (12 months or 18 months fixed-term)

AI Engineer (12 Months or 18 Months Fixed-Term)

About Khan Academy Khan Academy is a nonprofit with the mission to deliver a free, world-class education to anyone, anywhere. Our proven learning platform offers free, high-quality supplemental learning content and practice that cover Pre-K - 12th grade and early college core academic subjects, focusing on math and science. We have over 181 million registered learners globally and are committed to improving learning outcomes for students worldwide, focusing on learners in historically under-resourced communities. Our Community Our students, teachers, and parents come from all walks of life, and so do we. Our team includes people from academia, traditional/non-traditional education, big tech companies, and tiny startups. We hire great people from diverse backgrounds and experiences because it makes our company stronger. We value diversity, equity, inclusion, and belonging as necessary to achieve our mission and impact the communities we serve. We know that transforming education starts in-house with learning about ourselves and our colleagues. We strive to be world-class in investing in our people and commit to developing you as a professional. The Role As an AI Engineer, you'll take responsibility for integrating AI into Khan Academy product features, collaborating with our Product Management, Design, Engineering, and Content teams to develop tools and processes that ensure the consistency and quality of AI implementations. You will: Collaborate with designers, product managers, and engineers to build AI-driven features that support education use cases. Develop test datasets and evaluation criteria for the evaluation of AI outputs Measure, maintain, and improve AI output quality over time via experimentation with prompting, scaffolding, and implementation architectures What You Bring Strong Execution Technical Proficiency:

You have experience working in software engineering, data science, or related technical roles. Experience with python and/or go preferred. Applied AI experience:

You understand what generative AI models are good at and how to elicit the best performance from them. You have a knack for structured, analytical thought, and you're detail-oriented with high standards for quality. You understand techniquesincluding prompt chaining, RAG, tool-calling, and fine-tuningfor guiding generative AI outputs in service of a robust and performant enterprise product. Testing and quality assurance:

You're committed to a careful, iterative, data-driven approach for optimization, innovation, and continuous experimentation. You have experience developing evaluation data sets for benchmarking model fit and task-specific performance. Data Analysis:

You know how to analyze interaction data, both programmatically and manually, to identify actionable insights to optimize the user experience. You have experience using data to inform strategic decisions. Research:

You keep informed about developments in AI and take an active interest in emerging research and industry trends, and you understand the implications for our product's competitiveness and performance. Communication:

Your strong communication skills help you collaborate effectively with cross-functional teams, including educators, developers, and designers. You can explain technical concepts and create high quality documentation. Collaboration:

You have a history of working cross-functionally to achieve shared success in organization-wide goals and projects. Growth mindset:

You're adaptable to a fast-paced environment, and open to learning new tools and tech. Ethical Considerations and Bias Mitigation:

You're aware of ethical considerations in AI and machine learning, especially in an educational context, and are familiar with strategies for mitigating bias. Domain understanding:

You have a solid understanding of education technology, curriculum development, and learning science. Background/experience: Bachelor's degree, with a concentration in Computer Science or a related field preferred; Master's degree preferred. 2+ years of transferrable technical experience (e.g., software engineering, ML engineering, data science) 1+ years experience related to education (ed tech, instructional design, learning science research, teaching, etc.) Experience applying AI, machine learning, and natural language processing concepts to real life problems. A high level familiarity with the architecture and operation of large language models, and a nuanced understanding of their capabilities and limitations. A motivation for Khan Academy's mission "to provide a free world-class education for anyone, anywhere." How to apply? Our top candidate(s) will provide a resume and a cover letter which includes a detailed description of Their experience in prompt engineering and its relevance to this role. Their teaching experience and its relevance to this role. How they ensure the high quality of the prompts you create (use specific strategies and examples). Perks and Benefits We may be a non-profit, but we reward our talented team extremely well! We offer: Competitive salaries Ample paid time off as needed

Your well-being is a priority. Remote-first culture - that caters to your time zone, with open flexibility as needed, at times Generous parental leave An exceptional team that trusts you and gives you the freedom to do your best The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education Opportunities to connect through affinity, ally, and social groups And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life At Khan Academy we are committed to fair and equitable compensation practices, the well-being of our employees, and our Khan community. This belief is why we have built out a robust Total Rewards package that includes competitive base salaries, and extensive benefits and perks to support physical, mental, and financial well-being. The target salary range for this position is $107,712 - $123,599 USD / $145,552 - $181,940 CAD. The pay range for this position is a general guideline only. The salary offered will depend on internal pay equity and the candidate's relevant skills, experience, qualifications, and job market data. Additional incentives are provided as part of the complete total rewards package in addition to comprehensive medical and other benefits. More About Us Sal's TED talk from 2011 Sal's TED talk from 2015 Sal's TED talk from 2023 Our team Our Company Values Live & breathe learners We deeply understand and empathize with our users. We leverage user insights, research, and experience to build content, products, services, and experiences that our users trust and love. Our success is defined by the success of our learners and educators. Take a stand As a company, we have conviction in our aspirational point of view of how education will evolve. The work we do is in service to moving towards that point of view. However, we also listen, learn and flex in the face of new data, and commit to evolving this point of view as the industry and our users evolve. Embrace diverse perspectives We are a diverse community. We seek out and embrace a diversity of voices, perspectives, and life experiences leading to stronger, more inclusive teams and better outcomes. As individuals, we are committed to bringing up tough topics and leaning into different points of view with curiosity. We actively listen, learn and collaborate to gain a shared understanding. When a decision is made, we commit to moving forward as a united team. Work responsibly and sustainably