Senior Data Engineer - Audience Manager Platform
New Today
Job Summary:
Product Engineering is a unified team responsible for the engineering of Disney Entertainment & ESPN digital and streaming products and platforms. This includes product engineering, media engineering, quality assurance, engineering behind personalization, commerce, lifecycle, and identity.
This role involves building and maintaining the Audience Manager Platform (AMP), a centralized Disney audience data platform that captures & processes all Disney consumers cross channel behavior and delivers varying summarizations in a timely manner to multiple endpoints to support all business needs. At its core, it is a product that provides a comprehensive source of truth for customer data. It is built around customer profiles and is able to provide insights from across the business so stakeholders can quickly act on the data through activation pipelines.
The role requires expert knowledge of building scalable, fault-tolerant data processing pipelines and backend to ensure the reliable delivery of audience data.
Responsibilities and Duties of the Role:
Build and maintain audience platform initiatives to improve and expand audience targeting capabilities.
Partner with technical and non-technical colleagues to understand audience data and targeting requirements.
Work with engineering teams to collect required data from internal and external systems.
Support Agile methodologies such as Scrum by actively participating in regular ceremonies such as stand-up, retrospectives and sprint planning.
Design table structures and define ETL pipelines to build performant and scalable solutions
Develop Data Quality checks
Participate in on-call support
Develop and maintain ETL routines using ETL and orchestration tools such as Airflow
Perform ad hoc analysis and SQL and ETL tuning as necessary.
Participate in code reviews and problem-solving.
Required Education, Experience/Skills/Training:
Basic Qualifications
5+ years of big data engineering experience modeling and developing large data pipelines
Hands-on experience with distributed systems such as Spark, Hadoop (HDFS, Hive, Presto, PySpark) to query and process data
Strong Python and SQL skills processing big datasets
Experience with at least one major MPP or cloud database technology (Snowflake, Redshift, Big Query, Databricks)
Familiarity with Data Modeling techniques and Data Warehousing standard methodologies and practices
API and backend development experience
Required Education
Bachelor’s degree in Computer Science, Information Systems, Software, Electrical or Electronics Engineering, or comparable field of study, and/or equivalent work experience.
DISNEYTECH
The hiring range for this position in Los Angeles, CA is $138,900.00-$186,200.00 per year, in San Francisco, CA is $152,100.00 - $203,900 and in Seattle, WA is $145,400.00 to $195,000.00 per year. The base pay actually offered will take into account internal equity and also may vary depending on the candidate’s geographic region, job-related knowledge, skills, and experience among other factors. A bonus and/or long-term incentive units may be provided as part of the compensation package, in addition to the full range of medical, financial, and/or other benefits, dependent on the level and position offered.
- Location:
- Santa Monica