Kinyarwanda Phone-Based AI Evaluator

Position: Phone-Based AI Evaluator
Project Type: Project-based
Location: Currently based in Rwanda (Remote position)
Device: Applicants must already own a qualifying device and an Airtel SIM/number
Rate: USD $8 per hour worked within the pZero/Maestro platform
Project Status: This is a pipeline-building phase for a project launching very soon. We are selecting and onboarding qualified candidates now, so we can hit the ground running the moment we receive the green light from the client.

Project Requirements

• Native or expert-level fluency in Kinyarwanda, as spoken in Rwanda

• Must complete a language proficiency assessment as part of the application process

• Currently based in Rwanda

• Comfortable following simple written instructions in English

• Must already own a feature phone or low-end Android phone

• Must already have an Airtel SIM card/phone number

• Must be able to use that phone/number on 2G/3G service

• Must have access to a laptop or computer

The Project

We are seeking detail-oriented and motivated Kinyarwanda speakers in Rwanda to join a phone-based AI evaluation project.

Participants will use their own qualifying phone and Airtel number to call the client’s AI system, ask assigned prompts in Kinyarwanda, and complete the task flow in pZero/PPH Maestro.

Participants will record and evaluate the AI’s responses, then submit the required scorecards and feedback one prompt at a time.

Before beginning official project work, each participant must first complete a required Calibration Task. Only participants who successfully pass Calibration will move forward to the official project tasks.

       Workload

• This is project-based work with a variable, first-come, first-served workload.

• We generally allot 1 hour per prompt, and there are 25 prompts total.

• Because all participants must complete Calibration first, the minimum amount of work may be about 1 hour, and the maximum may be up to 25 hours, depending on calibration outcome, task availability, and how many prompts the participant is able to claim and complete.

• There is no guarantee of a minimum or maximum number of hours.

        Duties

• Use your own qualifying phone and Airtel number to call the client’s AI system

• Ask assigned prompts in Kinyarwanda

• Complete the task flow in pZero/PPH Maestro

• Evaluate the AI’s responses carefully and accurately

• Submit scorecards and feedback as instructed

• Follow all provided project instructions

• Perform all work with attention to quality, completeness, and detail
  
  Engagement Requirements: 

• All participants must have, or be willing to create, an Upwork account. The project will be managed via the Upwork platform.
• While participating in this project, adherence to the confidentiality terms outlined in the Upwork User Agreement is required. Any information accessed or received related to this project is confidential and may not be shared or disclosed to third parties.
• Work must be performed on the participant’s own devices.

Device Scope/Examples

The phone models below are examples only, not a strict whitelist. The most important factor is whether the participant’s actual phone + Airtel SIM setup works for the project’s 2G/3G requirement.

Feature phone examples:

• Nokia 105

• Nokia 105 Classic

• Nokia 110 (2G version)

• Nokia 150

• itel IT2165

Low-end Android examples:

• itel A56

• itel A56 Pro

• TECNO Pop 5

• TECNO Pop 5 Go
  
  Please note: To ensure eligibility for this project, applicants must be international freelancers. Unfortunately, we are unable to hire U.S. citizens, Green Card holders, or candidates currently residing in the U.S.
  
  About Us: 
  As a global data company, Productive Playhouse “PPH”, is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.  
  
  Originally founded as an educational production company, Productive Playhouse made a mark with our award winning children’s series, which taught fundamental subjects through engaging and effective programming. This early success paved the way for our evolution into a comprehensive data services provider.  
  
  Since 2011, Productive Playhouse has expanded rapidly to offer an extensive suite of data services. Our current offerings include transcription, translation, linguistic analysis, rating, systems testing, localization, field and studio recording, language skill verification, and specialized data handling with a focus on sensitivity and diversity.  Our commitment to innovation means we continually enhance our service portfolio to meet the evolving needs of our clients.
  
  At Productive Playhouse, we are proud of our reputation for addressing complex challenges with agility and delivering premium, secure data solutions across diverse environments. Our dynamic team is dedicated to maintaining the highest standards and ensuring exceptional service every time.  
  
  Disclaimer:
  The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary
  Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees.  Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.
  All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location.  Productive Playhouse participates in E-Verify.
  Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities.  If you need assistance or an accommodation due to a disability, please contact Human Resources.