Senior Data Engineer

New Yesterday

Job Summary:
This Senior Data Engineer role requires 7+ years of experience in data engineering, ETL, and SQL development. The position necessitates strong expertise in various ETL tools (Pentaho, Microsoft ADF), API development, and cloud platforms (AWS, Azure, GCP). The ideal candidate will possess experience with SAP BTP Integration Suite, data governance tools, and CI/CD pipelines, along with proficiency in SQL and a familiarity with Python and PySpark. Experience with SAP S/4HANA and cloud-based ERP implementations is also crucial. Location:
White plains, NY Responsibilities: - Design, develop, and maintain data pipelines using various ETL tools (Pentaho, Microsoft ADF).
- Develop and maintain APIs for data integration.
- Optimize SQL queries and stored procedures for performance.
- Implement and manage CI/CD pipelines for data workflows using Azure DevOps or similar tools.
- Work with data governance tools to ensure data quality and compliance.
- Integrate data from various sources, including SAP systems and cloud-based ERPs.
- Develop and maintain data integration solutions on AWS, Azure, and GCP.
- Troubleshoot and resolve data-related issues.
- Collaborate with other engineers and stakeholders to deliver data solutions.
- Implement and maintain event-driven architectures.
- Participate in SAP S/4HANA and cloud-based ERP implementations. Required Skills & Certifications: - 7+ years of experience in Data Engineering, ETL, and SQL development.
- Hands-on experience with SAP BTP Integration Suite for SAP and non-SAP integrations.
- Strong expertise in Pentaho (PDI), Microsoft ADF, and API development.
- Proficiency in SQL (stored procedures, query optimization, performance tuning).
- Experience working with Azure DevOps, GitHub, and CI/CD for data pipelines.
- Good understanding of data governance tools (Ataccama, Collibra) and data quality management.
- Experience working with AWS, Azure, and Google Cloud (GCP) for data integration and cloud-based workflows.
- Strong problem-solving skills and ability to work independently in a fast-paced environment.
- Experience working on SAP S/4HANA and cloud-based ERP implementations.
- Bachelor's or Master's degree in a relevant field like Computer science, Data Engineering or related technical field. Preferred Skills & Certifications: - Familiarity with Python, PySpark for data processing and automation.
- Knowledge of event-driven architectures.
- Familiarity with CI/CD for data pipelines (Azure DevOps, GitHub Actions, .
- Azure Data Engineer Associate certification.
- SAP Certified Associate Integration Developer certification. Special Considerations:
- None specified. Scheduling: - Not specified.
Location:
New York

We found some similar jobs based on your search