Search Satisfaction Grader

If you have a Candidate Login already, but have forgotten your password please use the steps to reset your password. If you have forgotten your email login, please contact [email protected] subject Workday Candidate Login

When creating your Workday account and entering personal information like name, address, please do not use ALL CAPS.

Thank you!

NOTICE:  For EMEA Jobs, please review the Privacy Policy here

Job Responsibilities:

We are seeking a detail-oriented and dedicated Search Satisfaction Grader to join our Search Evaluation Project. The primary responsibility of this role is to evaluate search results returned by an AI Assistant, ensuring they meet user intent, relevance, and contextual appropriateness according to established guidelines.The ideal candidate will possess strong analytical skills, excellent reading comprehension skills, a keen eye for detail, and the ability to provide insightful feedback to improve search functionalities.Project Details:Start Date: Immediately after completing the qualification processDuration: OngoingEmployment Type: W2 Full time Employee, eligible for benefitsLanguage: English (US)Pay Rate: $15/hour Schedule Expectations Work Hours: This is a full-time remote position requiring 40 hours per week, Monday through Friday. Training Phase: During the initial training phase, a set schedule will be required to ensure comprehensive onboarding and integration into the team. Flexible Schedule: Upon successful completion of the training phase, a flexible schedule may be offered, allowing for adjustments to better fit personal and professional needs while still meeting project deadlines and team collaboration requirements. Availability: Regular availability during standard business hours is essential to maintain communication and collaboration with team members and stakeholders. Location: Remote in the following States only: Arizona (AZ) Florida (FL) Georgia (GA) Illinois (IL) Maine (ME) Maryland (MD) Massachusetts (MA) Minnesota (MI) New Mexico (NM) Ohio (OH) Oregon (OR) Pennsylvania (PA) Texas (TX) Virginia (VA) Wisconsin (WI)By applying, you'll become part of our team, contributing to a range of projects tailored to your skills and availability, particularly highlighting localization and linguistic expertise.

Key Responsibilities:

• • Understand the Query: Analyze user queries to determine intent and possible meanings. Use web search links and research tools to comprehend the context and variations of the query.
  • Review and Assess Search Results: Evaluate the relevance and accuracy of the Assistant’s responses. Identify and flag issues such as wrong language, content unavailability, or inappropriate content.
  • Validate Results: Confirm the accuracy and appropriateness of search results. Ensure results align with user location, query date, and other contextual information.
  • Rate the Results: Assign satisfaction ratings (Highly Satisfying to Not Satisfying) based on the established guidelines. Consider factors such as user effort, source quality, and degrees of separation from the query concept.
  • Provide Feedback: Offer detailed feedback and comments on flagged results to aid in search improvement. Highlight common grading mistakes and ensure adherence to guidelines.
  • Continuous Improvement: Participate in training and certification processes. Stay updated with guideline changes and incorporate QA feedback into evaluations.

Requirements:

• • Fully Proficient in English (US): Linguistic competency in target language equal to ILR Level 5 or CEF C2
  • Preferred Areas of Education and or Experience and Focus, including but not limited to: Localization, Linguistics, Computer Science 
  •  A degree is not necessary but preferred. Students are welcome to apply. 
  • Preferred previous experience: in Search Relevance tasks, with e-commerce searches/websites
  • Skills:
  • Excellent online research skills
  • Attention to detail
  • Ability to perform thorough research within allocated time
  • Ability to follow instructions in English and comply with project conventions and rules
  • Excellent Reading Comprehension Skills
  • Understanding of User Intent
  • Tech Savvy

Additional Job Details:

Additional Requirements: 

• • Must sign a Non-Disclosure Agreement to protect client confidentiality 
  • Must pass training and a required quality test before starting work 
  • Must have work authorization in the US
  • Reliable computer system and internet connection

$15 - $15 an hourBenefits:·         Accident, Critical Illness, Hospital Indemnity Insurance·         Telemedicine Benefit·         Paid Sick Time·         Paid Holiday – 2 days·         Employee Assistance ProgramFollowing eligibility requirements:·         Medical Insurance, Dental Insurance, Vision Insurance, HSA, Voluntary Life Insurance·         401(k) Retirement PlanWhat to Expect- Collaborate on projects with leading tech companies in the AI industry.- Learn and develop skills with an experienced team involved in various aspects of AI technology.- Gain hands-on experience in the world of AI-driven search functionalities and localization.- Develop quality assurance testing skills that are applicable across multiple industries.Join our dynamic team and work with cutting-edge AI content, making a real impact in AI models, search evaluation, and localization. Gain valuable experience in the AI industry and contribute to the development and refinement of AI models.

apply to this job