Applied AI Engineer Codex Core Agent

Skills

About the Role

You will design and refine agent behavior for real-world coding tasks and long-horizon workflows. You will develop evaluations, investigate production failures, improve prompting and tool-use strategies, build feedback and data systems, and shape user-facing agent experiences with research, infrastructure, and product partners.

Requirements

• Experience building or shipping machine learning or LLM-powered products
• Python
• Modern ML tooling
• Experience with model evaluation, fine-tuning, or prompt design

Responsibilities

• Design and iterate on agent behaviors for coding tasks and long-horizon workflows
• Develop and run evaluations for performance, regressions, failure modes, and edge cases
• Improve performance through prompting, tool-use strategies, context construction, and model-facing experimentation
• Analyze production failures and improve robustness and reliability
• Build feedback loops and data systems for evaluation and research
• Shape user-facing agent experiences and interfaces
• Define quality standards for end-to-end complex agent tasks

Benefits

• Medical, dental, and vision insurance for employees and families
• Employer contributions to Health Savings Accounts
• Pre-tax Health FSA, Dependent Care FSA, and commuter accounts
• 401(k) retirement plan with employer match
• Paid parental, medical, and caregiver leave
• Flexible PTO for exempt employees or up to 15 days annually for non-exempt employees
• 13+ paid company holidays, paid office closures, and paid sick or safe time
• Mental health and wellness support
• Employer-paid basic life and disability coverage
• Daily office meals and eligible meal-delivery credits
• Relocation support for eligible employees
• Charitable donation matching and wellness stipends may be provided