We are looking for a

We are looking for a Data Engineer experienced in Azure Databricks , ADF , and PySpark to build and optimize ETL pipelines for a Data Lakehouse architecture.

Responsibilities

Build and maintain ETL processes using ADF, PySpark, Databricks Convert Informatica ETL workflows to cloud Ensure data quality, lineage, and performance Create self-service data products using semantic layers Work closely with data architects and business teams

Required Skills

8+ years in data engineering Strong skills in Databricks, PySpark, SQL, Azure Experience in legacy ETL migration Familiarity with financial risk datasets, data marts Agile project exposure and strong problem-solving skills

Skills: problem solving,etl,azure databricks,adf,pyspark,semantic layers,data engineering,agile,azure data factory,informatica,sql Seniority level Seniority level Mid-Senior level Employment type Employment type Contract Job function Job function Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Papigen by 2x Get notified about new Data Engineer jobs in Washington, DC . Washington, DC $101,000.00-$149,000.00 1 week ago Washington, DC $120,000.00-$170,000.00 1 month ago Washington DC-Baltimore Area $95,000.00-$112,000.00 5 days ago Arlington, VA $80,000.00-$89,000.00 1 month ago Arlington, VA $118,900.00-$205,600.00 22 hours ago North Bethesda, MD $55,000.00-$125,000.00 1 month ago Washington, DC $110,000.00-$120,000.00 3 weeks ago Washington, DC $120,000.00-$190,000.00 1 week ago Arlington, VA $95,000.00-$120,000.00 6 months ago Washington, DC $145,000.00-$204,000.00 1 week ago McLean, VA $80,000.00-$100,000.00 2 weeks ago Reston, VA $86,300.00-$164,000.00 7 months ago Chantilly, VA $235,000.00-$300,000.00 2 months ago Washington, DC $115,000.00-$165,000.00 1 week ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr