Sr. Data Engineer

New Yesterday

Responsibilities:
Architect, build, and optimize scalable data pipelines using Azure Data Factory (ADF), PySpark, SQL, and related Azure services Design and implement robust ETL frameworks to ingest and transform data from multiple ERP systems into a centralized enterprise data warehouse (EDW) Build and maintain medallion-style architecture (Bronze/Silver/Gold) to support scalable and trusted analytics Support and enhance the corporate EDW to ensure consistent, reliable reporting across business units Implement automated data quality, validation, and lineage checks to ensure reliable ingestion from source systems Collaborate with business and IT stakeholders to define data requirements and deliver executive-ready datasets Develop semantic models and unified data layers to streamline and standardize reporting logic across teams Troubleshot performance issues, pipeline failures, and system bottlenecks Contribute to data governance, security, access control, and regulatory compliance efforts Mentor junior engineers and serve as technical lead on cross-functional data initiatives Maintain comprehensive documentation of technical architecture, data flows, and design decisions Perform other duties as assigned Basic Qualifications: BS/BA in Computer Science or a related field 7+ years of proven experience as a data engineer preferred Proven success with Azure-based data tools including Azure Data Factory, Data Lake Storage, Delta Lake, and Synapse or Fabric Advanced proficiency in T-SQL and PySpark for high-volume data processing and transformation Experience building and maintaining medallion architecture in enterprise environments Advanced expertise in Azure Data Services, including Azure Data Factory (ADF), Data Lake, Synapse, and Fabric Strong proficiency in SQL, PySpark, and database query languages such as SQL/PSM Deep understanding of ETL/ELT best practices and dimensional data modeling Experience integrating and harmonizing data from multiple ERP systems Proficiency in data automation using Python or other scripting languages Familiarity with CI/CD, DevOps, and infrastructure-as-code best practices Knowledge of database design principles, structures and theories Hands-on experience with Power BI and enterprise business intelligence environments Strong Understanding of data governance, privacy, and compliance standards (, GDPR, CCPA) Experience with data quality frameworks and observability tools (, Microsoft Purview, Azure Monitor) Strong analytical and problem-solving skills Proven ability to lead data projects and work independently in dynamic environments Strong written and verbal communication skills, including technical documentation FDH Aero  is an Equal Opportunity Employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability status, protected veteran status, or any other characteristic protected by law.
Location:
Commerce

We found some similar jobs based on your search