LLM Model Response Evaluation

 

• Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
• The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
• The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
• Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
• Each task will include detailed project guidelines within the evaluation platform.

 

• 3+ years of hands-on experience in LLM / GenAI data evaluation.
• Master's or PhD required (PhD candidates strongly preferred).
• Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
• Comfortable evaluating content across multiple modalities 

• Flexible and remote work
• Variable workload:  Accept or decline tasks based on your availability
• No guaranteed hours:  Workload may vary weekly