Psychology & Counseling Expert (AI Conversation Evaluation)

Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for experienced professionals in psychology, social work, counseling, communication, qualitative research, HCI, conflict resolution, or related advisory disciplines to support an AI conversation-evaluation project.The role involves reviewing conversations between people and AI systems, assessing whether the AI gathered enough context before offering recommendations, identifying important missing information, and proposing relevant follow-up questions. Reviewers will distinguish between critical context and non-essential details and provide structured feedback to improve the quality of AI-assisted conversations.CONTRACT: Contractor assignment, 9 weeksCOMMITMENT: Full-time, 40 hours per week with at least 4 hours of PST overlapLOCATIONS: Remote - Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Turkey, or VietnamPROCESS: short online test and delivery reviewKey ResponsibilitiesReview AI conversations involving interpersonal, advisory, and everyday decision-making scenariosAssess whether the AI gathered sufficient context before making recommendationsIdentify important missing information and suggest relevant follow-up questionsDetermine whether additional context could materially change the recommendationDistinguish between load-bearing information and non-essential detailsConduct structured qualitative reviews using defined evaluation guidelinesDocument findings clearly in spreadsheets, annotation tools, or labeling platformsApply consistent judgment across cases and flag ambiguous examplesCollaborate with research and quality teams to improve evaluation standardsParticipate in calibration and quality-review activitiesRequirementsOne of the following academic or professional backgrounds:MSW with LCSW or an equivalent social-work licenseMA/MS with LMFT, LPC, LCPC, or an equivalent counseling licensePhD or PsyD in Clinical, Counseling, Social, or Industrial-Organizational PsychologyMA or PhD in HCI, Communication, Anthropology, Sociology, Conflict Resolution, Qualitative Research, or a closely related fieldRelevant professional credential combined with at least 5 years of direct advisory, coaching, mediation, consulting, or client-facing experienceAt least 3 years of relevant professional practice, with 5+ years preferred for credential-based applicantsExperience gathering missing context through interviews, assessments, consultations, or advisory conversationsAbility to distinguish critical information from non-essential contextStrong written English and qualitative analytical skillsStrong attention to detail and ability to follow detailed labeling guidelines