Evaluate and improve the safety, security, and robustness of large language models. Responsibilities include designing jailbreak, prompt injection, adversarial, and tool-use abuse tests; developing regression suites and evaluation frameworks; identifying vulnerabilities; translating findings into safety recommendations; and documenting methodologies and results for technical and non-technical stakeholders.
This role is for one of our clients
$50 - $90/hourpay
Role Title: AI Safety & Red Teaming Specialist
Role Type: Contractor
Location: Remote
We are looking for an experienced AI Safety & Red Teaming Specialist to help evaluate and strengthen the safety, security, and robustness of next-generation AI systems. In this role, you will leverage your expertise in adversarial AI, LLM security, and AI safety to identify vulnerabilities, design evaluation methodologies, and improve the resilience of large language models against real-world threats.
This opportunity is ideal for professionals passionate about AI security, ethical hacking, and developing robust evaluation frameworks for advanced AI systems.
RequirementsKey Responsibilities
- Design and implement advanced evaluation methodologies for AI system safety, including ethical jailbreak testing, prompt injection detection, LLM red teaming, and tool-use abuse scenarios.
- Develop cross-domain adversarial testing strategies to uncover complex, multi-turn attack patterns and model vulnerabilities.
- Build, maintain, and enhance regression test suites to continuously assess jailbreak susceptibility and prompt injection risks.
- Create comprehensive evaluation frameworks that simulate real-world adversarial threats to improve AI robustness and reliability.
- Collaborate with technical teams to translate security findings into actionable recommendations for AI safety improvements.
- Document testing methodologies, findings, and best practices through clear technical reports and presentations for both technical and non-technical stakeholders.
- 2+ years of experience in AI Safety, Adversarial Machine Learning, LLM Red Teaming, AI Security, or a related field.
- Hands-on experience researching, testing, or identifying vulnerabilities involving prompt injection, ethical jailbreaks, adversarial attacks, or tool-use exploitation.
- Strong understanding of modern LLM architectures, prompt engineering, and AI safety evaluation methodologies.
- Experience developing structured security assessments, regression testing frameworks, and adversarial evaluation strategies.
- Excellent analytical, documentation, and communication skills with the ability to explain complex technical findings clearly.
- Ability to collaborate effectively within cross-functional technical teams.
- Master's or PhD in Computer Science, Cybersecurity, Machine Learning, Artificial Intelligence, or a related discipline.
- Contributions to AI security research, open-source AI safety tools, conference presentations, or published research.
- Experience with AI model evaluation frameworks, prompt engineering techniques, and AI security assessment tools.
- Background in multidisciplinary AI safety, cybersecurity, or adversarial machine learning projects.
- AI Safety
- LLM Red Teaming
- Prompt Injection
- Adversarial Machine Learning
- Ethical Jailbreaking
- AI Security
- Prompt Engineering
- AI Evaluation Frameworks
Similar Jobs
Events • Food • Travel • Hospitality • Hotels & Resorts
Provides hands-on training across hotel departments, including front office, guest services, housekeeping, and operations. Supports check-ins and check-outs, guest inquiries, room allocations, payments, guest records, event coordination, and complaint resolution. Collaborates with teams to deliver exceptional hospitality while learning hotel procedures, service standards, and property management systems. Requires strong communication, flexibility, English proficiency, basic computer skills, and availability for evenings, weekends, and holidays.
Top Skills:
Property Management Systems (Pms)
Events • Food • Travel • Hospitality • Hotels & Resorts
Manage daily food and beverage operations across dining outlets, ensuring quality, service excellence, profitability, regulatory compliance, and guest satisfaction. Lead administrative planning, cost controls, marketing strategies, and continuous service improvements. Supervise, coach, and develop team members while maintaining health, safety, sanitation, and alcohol-awareness standards. The role requires hospitality education, 5–7 years of food and beverage operations experience, leadership skills, POS and inventory-management familiarity, and fluent English.
Top Skills:
Inventory Management ToolsPos Systems
Cloud • Security • Software • Cybersecurity • Automation
Drive enterprise sales across Mumbai, focusing on BFSI institutions, conglomerates, and large enterprises. Responsibilities include prospecting, pipeline generation, full-cycle deal management, account planning, executive stakeholder engagement, negotiations, forecasting, and post-sales expansion. The role requires positioning GitLab’s DevSecOps platform against security, compliance, regulatory, data residency, and modernization priorities while coordinating Solutions Architects, Customer Success, partners, and internal teams.
Top Skills:
Ci/CdCloud InfrastructureDevsecopsGitlabHybrid CloudPrivate CloudSaaS
What you need to know about the Pune Tech Scene
Once a far-out concept, AI is now a tangible force reshaping industries and economies worldwide. While its adoption will automate some roles, AI has created more jobs than it has displaced, with an expected 97 million new roles to be created in the coming years. This is especially true in cities like Pune, which is emerging as a hub for companies eager to leverage this technology to develop solutions that simplify and improve lives in sectors such as education, healthcare, finance, e-commerce and more.
