Information TechnologyFull-TimeJunior-level(1-2 yrs)
Job Description
We are looking for a highly skilled Quality Analyst Project Coordinator to support the development of advanced AI tools for product attribution, classification, and other purposes. This project focuses on creating a rich and diverse dataset of written Italian text, annotated and corrected by humans. The role involves auditing labeled datasets, identifying quality trends, and collaborating with cross-functional teams to ensure high standards for AI training data.
Responsibilities
Review and audit labeled datasets for both text and image-based content to ensure accuracy, consistency, and adherence to guidelines.
Document and share feedback with the individual labelers.
Identify trends and insights in quality performance, and effectively mitigate quality performance issues.
Communicate quality trends and insights to the customer. Calibrate with the customer on instructions and edge cases.
Evaluate responses generated by AI, verifying correctness, clarity, relevance, and alignment with task instructions.
Apply knowledge of the Consumer Packaged Goods (CPG) domain to accurately classify and/or describe products.
Collaborate with cross-functional teams to update labeling workflows and improve quality.
Monitor performance metrics (e.g., accuracy rates, inter-rater agreement) and contribute to continuous improvement initiatives.
Generate responses with intentional but realistic grammar, spelling, and structural errors.
Participate in calibration sessions to align QA standards across teams and help train new reviewers or analysts.
Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
Ensure that documentation is up to date.
Qualifications and Requirements
Education: BA/BSc/HND degree required.
Language Skills: Minimum C1 English proficiency and C2 level of Italian proficiency.
Experience: 2 years of working experience in a corporate/business environment.
Specialized Experience: Prior experience in Linguistic QA, Data annotation for NLP/AI projects, or ESL/EFL teaching/editing/copyediting.
Technical Skills: Ability to follow linguistic and situational writing prompts; comfortable reviewing and providing feedback on structured data.
Soft Skills: Keen eye for detail, excellent written communication, and coordination skills.
Management Skills: Ability to give actionable and constructive feedback; experience with creating and tracking timelines/milestones is a plus.
Interested and qualified candidates should apply online via the Sama application portal by clicking this link: https://www.myjobmag.co.ke/apply-now/1160503. Ensure you meet the C2 Italian and C1 English proficiency requirements before applying.