University Of Florida
Data Scientist II - Office of Medical Education
University Of Florida, Gainesville, Florida, us, 32635
Overview
Data Scientist II – Office of Medical Education. Location: Main Campus (Gainesville, FL). Job number: 537179. Work type: Staff Full-Time. Categories: Grant or Research Administration, Health Care Administration/Support. Department: 29010805 - MD-MEDICAL EDUCATION. Classification Title: Data Scientist II. The Data Scientist II reports to the Assistant Dean for Assessment, Evaluation, and Scholarship and provides support to the Medical Director of Anaclerio Learning and Assessment Center (ALAC) and the Assistant Dean of Medical Education Research, Scholarship & Faculty Development. This senior role leads the College of Medicine’s analysis and reporting of medical education assessments with a focus on Clinical Skills Examinations (CSEs). The position applies advanced psychometric methodologies to enhance the validity of high-stakes evaluations. The position also spearheads educational research and scholarship initiatives, overseeing project design, regulatory compliance, data management, and dissemination. Through collaboration, the position supports faculty and trainee development and contributes to the advancement of medical education through rigorous analytics and scholarly output. About This Role:
Psychometric Analysis Create psychometric analyses (CTT, IRT, factor, and generalizability/reliability studies) to evaluate and improve high-stakes assessments. Conduct inter-rater reliability analyses to improve validity and provide consistency by reducing score drift. Collaborate with the Medical Director of ALAC to design and facilitate standard-setting panels, justify defensible passing scores, and revise grading schemas and scoring models. Hypothesize ideas to strengthen the reliability, validity, and fairness of CSEs and related high-stakes clinical skills assessments in collaboration with the Medical Director. Present actionable psychometric reports to provide continuous quality improvement. Programmatic Assessment Lead analysis, interpretation, and reporting of performance for medical education assessments, including performance data for the CSE. Develop and maintain learning analytics that inform progress, continuous quality improvement and summative reporting to program leadership. Report recurring updates and data summaries to leadership. Research, Scholarship, and Project Management Design, implement, and analyze educational research projects in collaboration with the Assistant Dean of Medical Education Research, Scholarship, and Faculty Development. Provide oversight and guidance for faculty/trainee projects, including study design, methodology, data management, and project deliverables. Prepare and manage regulatory documents (IRB applications, data use agreements) to ensure compliance with research standards. Create and maintain longitudinal datasets and performance reports to support program evaluation and scholarly initiatives. Lead grant development and submission processes to secure internal and external funding. Produce high-quality technical writing, including abstracts, manuscripts, and conference presentations to ensure reproducibility and transparency. Mentor faculty and trainees in scholarly dissemination and manuscript preparation, including response to peer review. We Offer Exceptional Benefits: Low-cost State Health Plans: Medical, Dental, and Vision Insurance Life and Disability Insurance Generous Retirement Options to secure your future Comprehensive Paid Time Off Packages: includes over 10 paid holidays, as well as paid family, sick and vacation leave Exceptional Personal and Professional Development Opportunities: Access to UF Training & Organizational Development programs, leadership development, LinkedIn Learning, and more Tuition Assistance through the UF Employee Education Program Public Service Loan Forgiveness (PSLF) Eligible Employer About the College of Medicine: The University of Florida's College of Medicine is committed to advancing health through education, research, and patient care. The college emphasizes interdisciplinary collaboration and community engagement, fostering an environment where students, faculty, and staff work together to improve healthcare outcomes. The College is home to cutting-edge research initiatives and state-of-the-art facilities, providing an exceptional training ground for aspiring medical professionals. For more information about the College of Medicine and its programs, visit College of Medicine. Salary: $70,000 - $80,000 annually; commensurate with education and experience. Required Qualifications
A Bachelor’s Degree in data science, statistics, bioinformatics, analytics, or similar field and three years of experience; Master’s Degree in data science, statistics, bioinformatics, analytics, or similar field and one year of experience; Doctoral Degree in data science, statistics, bioinformatics, analytics, or similar field. Preferred Qualifications
Doctorate (Ph.D./Ed.D.) in psychometrics, educational measurement, statistics, or a related field. Experience with psychometric procedures and methods, including classical test theory, item response theory, and adaptive testing. 3+ years with a strong record of scholarship and leadership in health professions education. Proficiency in statistical analysis software (e.g., R, Python, SAS, SPSS, Stata) and strong skills in data cleaning, management, and quality assurance. Experience conducting rigorous analyses in medical education or related social/health sciences, with strong written and verbal communication for research dissemination. Experience leading standard setting, building weighted grading/score models, and producing longitudinal competency profiles in clinical skills and clerkship contexts. Experience with technical writing (grants and manuscripts). Demonstrated ability to manage multiple complex projects with minimal supervision and to collaborate effectively with faculty, staff, and trainees. Special Instructions to Applicants
In order to be considered, you must upload your cover letter, resume, and contact information for three professional references. If an accommodation due to a disability is needed to apply for this position, please call 352-392-2477 or the Florida Relay System at 800-955-8771 (TDD). Application must be submitted by 11:55 p.m. (ET) of the posting end date. Health Assessment Required: No Advertised:
17 Sep 2025 Eastern Daylight Time Applications close:
01 Oct 2025 Eastern Daylight Time The University of Florida is an Equal Employment Opportunity Employer. We will email you new jobs that match this search.
#J-18808-Ljbffr
Data Scientist II – Office of Medical Education. Location: Main Campus (Gainesville, FL). Job number: 537179. Work type: Staff Full-Time. Categories: Grant or Research Administration, Health Care Administration/Support. Department: 29010805 - MD-MEDICAL EDUCATION. Classification Title: Data Scientist II. The Data Scientist II reports to the Assistant Dean for Assessment, Evaluation, and Scholarship and provides support to the Medical Director of Anaclerio Learning and Assessment Center (ALAC) and the Assistant Dean of Medical Education Research, Scholarship & Faculty Development. This senior role leads the College of Medicine’s analysis and reporting of medical education assessments with a focus on Clinical Skills Examinations (CSEs). The position applies advanced psychometric methodologies to enhance the validity of high-stakes evaluations. The position also spearheads educational research and scholarship initiatives, overseeing project design, regulatory compliance, data management, and dissemination. Through collaboration, the position supports faculty and trainee development and contributes to the advancement of medical education through rigorous analytics and scholarly output. About This Role:
Psychometric Analysis Create psychometric analyses (CTT, IRT, factor, and generalizability/reliability studies) to evaluate and improve high-stakes assessments. Conduct inter-rater reliability analyses to improve validity and provide consistency by reducing score drift. Collaborate with the Medical Director of ALAC to design and facilitate standard-setting panels, justify defensible passing scores, and revise grading schemas and scoring models. Hypothesize ideas to strengthen the reliability, validity, and fairness of CSEs and related high-stakes clinical skills assessments in collaboration with the Medical Director. Present actionable psychometric reports to provide continuous quality improvement. Programmatic Assessment Lead analysis, interpretation, and reporting of performance for medical education assessments, including performance data for the CSE. Develop and maintain learning analytics that inform progress, continuous quality improvement and summative reporting to program leadership. Report recurring updates and data summaries to leadership. Research, Scholarship, and Project Management Design, implement, and analyze educational research projects in collaboration with the Assistant Dean of Medical Education Research, Scholarship, and Faculty Development. Provide oversight and guidance for faculty/trainee projects, including study design, methodology, data management, and project deliverables. Prepare and manage regulatory documents (IRB applications, data use agreements) to ensure compliance with research standards. Create and maintain longitudinal datasets and performance reports to support program evaluation and scholarly initiatives. Lead grant development and submission processes to secure internal and external funding. Produce high-quality technical writing, including abstracts, manuscripts, and conference presentations to ensure reproducibility and transparency. Mentor faculty and trainees in scholarly dissemination and manuscript preparation, including response to peer review. We Offer Exceptional Benefits: Low-cost State Health Plans: Medical, Dental, and Vision Insurance Life and Disability Insurance Generous Retirement Options to secure your future Comprehensive Paid Time Off Packages: includes over 10 paid holidays, as well as paid family, sick and vacation leave Exceptional Personal and Professional Development Opportunities: Access to UF Training & Organizational Development programs, leadership development, LinkedIn Learning, and more Tuition Assistance through the UF Employee Education Program Public Service Loan Forgiveness (PSLF) Eligible Employer About the College of Medicine: The University of Florida's College of Medicine is committed to advancing health through education, research, and patient care. The college emphasizes interdisciplinary collaboration and community engagement, fostering an environment where students, faculty, and staff work together to improve healthcare outcomes. The College is home to cutting-edge research initiatives and state-of-the-art facilities, providing an exceptional training ground for aspiring medical professionals. For more information about the College of Medicine and its programs, visit College of Medicine. Salary: $70,000 - $80,000 annually; commensurate with education and experience. Required Qualifications
A Bachelor’s Degree in data science, statistics, bioinformatics, analytics, or similar field and three years of experience; Master’s Degree in data science, statistics, bioinformatics, analytics, or similar field and one year of experience; Doctoral Degree in data science, statistics, bioinformatics, analytics, or similar field. Preferred Qualifications
Doctorate (Ph.D./Ed.D.) in psychometrics, educational measurement, statistics, or a related field. Experience with psychometric procedures and methods, including classical test theory, item response theory, and adaptive testing. 3+ years with a strong record of scholarship and leadership in health professions education. Proficiency in statistical analysis software (e.g., R, Python, SAS, SPSS, Stata) and strong skills in data cleaning, management, and quality assurance. Experience conducting rigorous analyses in medical education or related social/health sciences, with strong written and verbal communication for research dissemination. Experience leading standard setting, building weighted grading/score models, and producing longitudinal competency profiles in clinical skills and clerkship contexts. Experience with technical writing (grants and manuscripts). Demonstrated ability to manage multiple complex projects with minimal supervision and to collaborate effectively with faculty, staff, and trainees. Special Instructions to Applicants
In order to be considered, you must upload your cover letter, resume, and contact information for three professional references. If an accommodation due to a disability is needed to apply for this position, please call 352-392-2477 or the Florida Relay System at 800-955-8771 (TDD). Application must be submitted by 11:55 p.m. (ET) of the posting end date. Health Assessment Required: No Advertised:
17 Sep 2025 Eastern Daylight Time Applications close:
01 Oct 2025 Eastern Daylight Time The University of Florida is an Equal Employment Opportunity Employer. We will email you new jobs that match this search.
#J-18808-Ljbffr