Red team conversational AI models and agents. Focus on jailbreaks, prompt injections, misuse cases, and bias exploitation.
Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic risks.
Apply structure by following taxonomies, benchmarks, and playbooks to maintain consistent testing.
Document reproducibly. Produce reports, datasets, and attack cases that customers can act on.
Review AI outputs on sensitive topics like bias, misinformation, or harmful behaviors. Participation in higher-sensitivity projects is optional and supported by guidelines and wellness resources.
Qualifications
Must-Have
Native fluency in English and Malayalam.
Strong judgment about language and content. Ability to assess AI response accuracy, completeness, and appropriateness.
Rigorous attention to detail. Notice subtle errors, inconsistencies, and gaps.
Structured approach. Adhere to guidelines and quality standards consistently.
Strong communication skills. Explain reasoning clearly to technical and non-technical audiences.
Adaptability. Thrive across projects, task types, and customers.
Preferred
Knowledge in Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction.
Experience in Cybersecurity: penetration testing, exploit development, reverse engineering.
Understanding of socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing.
Skills in creative probing: psychology, acting, writing for unconventional adversarial thinking.