Ai Image Evaluation Expert job at Yohr consultancy

Role Overview

Collaborating with a leading AI lab to identify detail-oriented image evaluation specialists for a project focused on assessing AI-powered image editing systems. In this project, you will evaluate how accurately and effectively AI models modify images based on user instructions. Your work will directly contribute to improving the quality, safety, and reliability of frontier multimodal models. This is a project-based opportunity suited for professionals with strong visual judgment and structured evaluation skills.

Key Responsibilities

• Review original images, user edit instructions, and AI-generated edited images
• Conduct a pre-evaluation feasibility check to confirm the instruction is valid and achievable
• Flag unsafe, harmful, or policy-violating content in edited outputs
• Assess instruction adherence, structural integrity, and preservation of unedited areas
• Evaluate visual quality, style alignment, and character consistency
• Provide structured ratings across defined grading dimensions
• Deliver clear, consistent evaluations following detailed rubric guidelines

Ideal Qualifications

• Experience in image review, visual quality assurance, content moderation, or related fields
• Strong attention to detail and ability to identify subtle visual inconsistencies
• Familiarity with image editing concepts, digital art, or generative AI systems
• Ability to apply structured evaluation rubrics consistently and objectively
• Clear written communication skills for documenting assessments
• Comfort reviewing a wide range of visual content, including potentially sensitive material

Contract and Payment Terms

You will be engaged as an independent contractor.

This is a fully remote role that can be completed on your own schedule.

Projects can be extended, shortened, or concluded early depending on needs and performance.

Payments are weekly on Stripe or Wise based on services rendered.

• Review original images, user edit instructions, and AI-generated edited images
• Conduct a pre-evaluation feasibility check to confirm the instruction is valid and achievable
• Flag unsafe, harmful, or policy-violating content in edited outputs
• Assess instruction adherence, structural integrity, and preservation of unedited areas
• Evaluate visual quality, style alignment, and character consistency
• Provide structured ratings across defined grading dimensions
• Deliver clear, consistent evaluations following detailed rubric guidelines

• Strong attention to detail and ability to identify subtle visual inconsistencies
• Ability to apply structured evaluation rubrics consistently and objectively
• Clear written communication skills for documenting assessments

• Experience in image review, visual quality assurance, content moderation, or related fields
• Familiarity with image editing concepts, digital art, or generative AI systems
• Comfort reviewing a wide range of visual content, including potentially sensitive material