Senior Member of Technical Staff Safety and Security for Agents

Skills

About the Role

You will develop data generation, post-training, and evaluation methods for safer agentic language models. You will design data-collection tasks, analyze data quality and bias, train large language models, evaluate robustness, and collaborate with machine learning, annotation, product, and policy teams.

Requirements

• Statistics
• Scientific experiment evaluation
• Software engineering
• Data collection
• Human annotation
• Dataset analysis
• Data quality
• Bias analysis
• Large language model training
• Distributed training
• Machine learning
• Generalizability
• Robustness
• Python
• PyTorch
• TensorFlow
• JAX
• Communication

Responsibilities

• Develop data generation, post-training, and evaluation methods for safer language models.
• Design and conduct data-collection tasks with human annotators.
• Analyze dataset quality, bias, and suitability for machine-learning training.
• Train large language models on distributed infrastructure.
• Evaluate and improve the generalizability and robustness of machine-learning systems.
• Collaborate with machine learning, data annotation, product, and policy teams.

Benefits

• Equity
• Weekly lunch stipend of $75/£75 or equivalent local currency
• Health and dental benefits
• Mental health budget
• RRSP matching, 401K, and Pension Scheme
• 100% parental leave top-up for up to 6 months
• Annual enrichment benefits
• Education and learning stipend
• 6 weeks of paid vacation
• Budget for travel to other offices for remote employees
• Annual company offsite
• Daily lunch program for office employees
• Snacks
• Community and social events
• Co-working benefit
• $500 home office stipend