Engineering Analyst, Trust and Safety Responsible AI Testing
- linkCopy link
- emailEmail a friend
Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 7 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
- 7 years of experience managing projects and defining project scope, goals, and deliverables.
- 7 years of experience with one or more of the following languages: SQL, R, Python, or C++.
- 5 years of experience working in a Trust and Safety Operations, data analytics, cybersecurity, or other related environment.
Preferred qualifications:
- Master's degree or PhD in a quantitative or engineering field.
- Experience in designing and conducting experiments or quantitative research, in a technology or AI context.
- Experience working with Large Language Models, LLM Operations, prompt engineering, pre-training, and fine-tuning.
- Understanding of AI systems, machine learning, and their potential risks.
- Excellent written and verbal communication and presentation skills and the ability to influence cross-functionally at various levels.
- Excellent problem-solving and critical thinking skills with attention to detail and the ability to think strategically and identify emerging threats and vulnerabilities.
About the job
Fast-paced, dynamic, and proactive, YouTube’s Trust & Safety team is dedicated to making YouTube a safe place for users, viewers, and content creators around the world to create, and express themselves. Whether understanding and solving their online content concerns, navigating within global legal frameworks, or writing and enforcing worldwide policy, the Trust & Safety team is on the frontlines of enhancing the YouTube experience, building internet safety, and protecting free speech in our ever-evolving digital world.
As an Engineering Analyst within the Trust and Safety Responsible AI Testing Team, you’ll be part of a global team that drives One Google solutions for industry-leading responsible AI applications.
You will focus on the broad spectrum safety, and neutrality risks and prioritize close partnerships with colleagues in Google Deep Mind (GDM) to design and develop solutions to further Google’s ability to prevent abuse on GDM base models.
You will blend your domain expertise in safety policy and GenAI testing processes with strong technical acumen in experimental design, data science, and engineering experience to drive creative and solutions to challenges, with the ultimate impact of improving user safety in GenAI products.
At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.
Responsibilities
- Drive structured and unstructured testing of novel model modalities and capabilities, collaborating with Google DeepMind.
- Lead platform and tooling development, designing engineering solutions and prompt generation strategies, leveraging LLMs to scale adversarial testing and bridge technical constraints.
- Define and ensure adherence to testing and safety standards in collaboration with cross-functional teams, including policy and engineering.
- Perform analyses, develop insights for model and product-level safety mitigations, and influence strategic safety initiatives across Product, Engineering, Research, and Policy. Act as a key advisor to leadership on complex safety issues and represent Google's AI safety efforts externally.
- Be exposed to graphic, controversial, or upsetting content.
Information collected and processed as part of your Google Careers profile, and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.
Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.
If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.
Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.
To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.