Data Engineer Core Experimentation
AI research and deployment company building and deploying frontier AI products, including ChatGPT, Codex, and its API platform.
Projects
About OpenAI
OpenAI’s mission is to ensure artificial general intelligence benefits all of humanity. It consists of the nonprofit OpenAI Foundation and OpenAI Group, a public benefit corporation governed by the Foundation.
Skills
Candidate Availability
Required and preferred rules are kept separate and reflect the wording in the original posting.
About the Role
You will design, build, and manage data pipelines that integrate user-event data into the data warehouse. You will develop canonical datasets for product metrics, build reliable ingestion and processing systems, collaborate on data solutions, contribute to architecture decisions, and protect data security, integrity, and compliance.
Requirements
- 3+ years of data engineering experience.
- 8+ years of software engineering experience, including data engineering.
- Proficiency in Python, Scala, Java, or another data-engineering programming language.
- Experience with distributed processing technologies, including Hadoop or Flink.
- Experience with distributed storage systems such as HDFS or S3.
- Experience with ETL schedulers such as Airflow, Dagster, or Prefect.
- Understanding of Spark and ability to write, debug, and optimize Spark code.
Responsibilities
- Design, build, and manage data pipelines for user-event data.
- Develop canonical datasets for user growth, engagement, and revenue metrics.
- Partner with infrastructure, data science, product, marketing, finance, and research teams on data needs.
- Implement fault-tolerant data-ingestion and processing systems.
- Participate in data architecture and engineering decisions.
- Ensure data security, integrity, and compliance.
Benefits
- Medical, dental, and vision insurance for employees and their families with employer Health Savings Account contributions.
- Pre-tax Health FSA, Dependent Care FSA, and commuter accounts.
- 401(k) retirement plan with employer match.
- Paid parental, medical, and caregiver leave.
- Flexible PTO for exempt employees or up to 15 days annually for non-exempt employees.
- 13+ paid company holidays, paid office closures, and paid sick or safe time.
- Mental health and wellness support.
- Employer-paid basic life and disability coverage.
- Daily office meals and eligible meal-delivery credits.
- Relocation support for eligible employees.
- Charitable donation matching and wellness stipends may be provided.
