Lead Data Engineer

New Yesterday

Title: Lead Data Engineer Location: Houston, TX 77002 (ONSITE) Duration: Direct Hire Work Requirements: US Citizen, GC Holders or Authorized to Work in the U.S.
Job Description: Seeking a Lead Data Engineer that will architect, design, and implement a cloud based modern enterprise data platform to support data analytic use cases for the midstream oil and gas business units. This individual will lead the development of enterprise-wide data strategies enabling advanced analytical uses case and driving innovation through modern cloud technologies.
Responsibilities include:
Architect, design, and implement comprehensive cloud-based data architectures Develop data models, data flow diagrams, and technical specifications for complex data ecosystem Create reference architectures and design patterns for data ingestion, processing, storage, and analytics Lead cross-functional teams in the design and implementation of data products Collaborate with data engineers, analysts, data scientists, and stakeholders to translate business requirements into technical solutions Provide technical guidance on cloud data services including data lakes, data warehouses, and streaming platforms Create and implement strategies for migrating on-premise data platforms to cloud environments Develop and implement long-term data architecture roadmaps aligned with business objectives Define and implement data integration strategies across multiple systems and platforms Implement complex modules and core services of the data platform ensuring correctness, reliability, scalability, and stability Mentor junior data engineers in design and code reviews and implementation best practices Qualifications
The successful candidate will meet the following qualifications: 7+ years of experience as a hands-on Data Engineer designing and implementing enterprise-wide data platform architectures Expert level experience in Python and SQL Expert level experience in dimensional modeling, data vault methodology, and modern data modeling techniques Deep expertise in at least one major cloud provider (AWS, Azure, GCP) with knowledge of their data services Experience in various data integration patterns including ETL, ELT, Pub/Sub, Streaming, and Change Data Capture Experience with common Python Data Engineering packages including Pandas, NumPy, Pyarrow PyTest, Scikit-Learn, and Boto3 Experience with Infrastructure as Code principals and tools such as Terraform and Cloud Formation Experience in software development practices such as Design Principles and Patterns, Modularity, Unit Testing, Refactoring, CI/CD, and version control Experience building data products leveraging Snowflake, DBT, and Airflow Experience in implementing Data Lakehouse patterns using Apache Iceberg or Delta Lake Excellent communication skills with ability to present complex technical concepts to non-technical stakeholders
About INSPYR Solutions Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we strategically align industry and technical expertise with our clients' business objectives and cultural needs. Our solutions are tailored to each client and include a wide variety of professional services, project, and talent solutions. By always striving for excellence and focusing on the human aspect of our business, we work seamlessly with our talent and clients to match the right solutions to the right opportunities. Learn more about us at inspyrsolutions.com.
INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities
25-15448
Apply
Location:
Houston, TX, United States
Category:
Computer And Mathematical Occupations

We found some similar jobs based on your search