Our Trust and Safety Team is dedicated to protecting Roblox users and developers from those who want to do harm online and IRL. As Senior Program Manager for Automation and Labeling, you will manage multiple processes ranging from labeling and annotating text data for AI models and ensuring our voice moderation continues to perform at a high level. You will work with Product Managers, Data Scientists and Engineers to drive the holistic labeling project forward from inception to execution.

You will report to the Senior Manager, Intelligence and Investigations on our world-class Trust & Safety team. 

This role is full-time and located at our headquarters in San Mateo, California. 

You Will

• Build and manage the process for a team of text labeling specialists to ensure that labeling enables our AI models to protect the community.
• Develop and implement labeling guidelines to ensure consistency and accuracy across labeled data.
• Monitor quality control measures to ensure that labeled data meets the required quality standards.
• Collaborate with Product Managers, Data Scientists and Engineers to ensure that labeled data is delivered on time and to the required specifications.
• Analyze labeling data and provide insights to improve the labeling process and the performance of machine learning models.
• Manage labeling workflows, ensuring that labeling tasks are prioritized and assigned appropriately.
• Work with team members to adjust text filters to react quickly to latest trends or emerging issues.

You Have:

• 5+ years of experience in moderation, machine learning model training, education or analysis 
• Experience working with vendors and remote teams
• Fluency in another language and experience working with multi-lingual teams.
• Experience with project management tools and methodologies.
• Experience working with sensitive or disturbing content