This position involves authoring, reviewing, and annotating technical tasks designed to evaluate AI model performance in psychology-related scenarios. The role focuses on creating original problem sets based on experimental designs, statistical plots, and behavioral data figures, as well as writing reference solutions and conducting structured quality checks.

• Develop original problem sets grounded in experimental designs and behavioral data.
• Write reference solutions for technical tasks.
• Conduct structured quality checks on tasks to ensure accuracy and reliability.

• PhD in Psychology, or PsyD or MS in Psychology with 3+ years of clinical, research, or applied experience, or BA/BS in Psychology with 5+ years of applied research, clinical support, or teaching experience.
• Working fluency in at least two areas of psychology: cognitive, clinical, developmental, social, or biological.
• Ability to read and interpret experimental designs, statistical plots, and behavioral data figures.
• Strong technical writing skills, with the ability to articulate reasoning step-by-step in written form.

This is a part-time position requiring approximately 20 hours per week with a flexible schedule. The role is fully remote and compensated on an hourly basis.

The starting rate is $70 per hour, with opportunities for promotion based on task quality and throughput.