Data Annotator - Video Evaluation (Remote, Flexible, Worldwide)
Careerflow
IT
India
USD 2.5-3.5 / hour
About the Role
A US based AI company that is at the forefront of AI research is looking for a detail-oriented and analytically consistent Annotator to evaluate visual and creative content using structured rating frameworks and detailed guidelines.
In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems.
This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks.
What You Will Do
Evaluate visual and media content using structured guidelines and predefined rating frameworks.
Provide clear, well-structured written justifications to support evaluation decisions.
Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks.
Identify quality gaps related to realism, composition, motion, lighting, and overall production standards.
Job Requirements
3+ years of professional work experience
Media/agency experience is mandatory
Hands-on experience working directly with designers, photographers, or videographers (mandatory)
Experience with AI image or video generation tools is a strong plus
Strong understanding of motion realism, lighting, camera movement, composition, and production quality
Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English.
Incorporate feedback from LLM performance metrics into training data creation.
Ability to commit to 40 hours per week and candidates who can join immediately preferred.
Required Qualifications
Bachelor’s degree or higher in:
Design, Visual Communication, or Fine Arts
Film, Media, Animation, or VFX
Photography or Cinematography
Architecture or Industrial Design
Creative Writing or equivalent professional experience in content creation, media production, or content review.
Application Process
Submit your resume, profile, and questionnaire here on this job description
If you are selected, you will receive an Interest Confirmation Form (ICF)
An Assessment will be shared after 2-3 days of application.
If you pass the assessment, you can start immediately
Pay, Compensation, and further details
Pay: $2.5 to $3.5 per hour depending on experience (Approximately Rs. 40,000 per month for 40 hours per week)
Assignment Type: Independent Contract
Total Number of Positions: 350
Start Date: May 28th, 2026
Commitment Required: 40 hours per week (6 hours overlap with PST)
Years of Experience: 3 Years of Experience required
Engagement Length: 4 weeks