Data Engineer with Data Bricks

New Yesterday

Position : Data Engineer with Data Bricks Location : Colombus, OH, onsite
Key Responsibilities Design, build, and manage scalable data pipelines using Databricks and Apache Spark . Develop ETL/ELT workflows for batch and streaming data processing from structured and unstructured sources. Collaborate with Data Scientists, Analysts, and BI teams to deliver clean, reliable datasets for analytics and ML models. Implement Delta Lake for scalable and ACID-compliant data lake management. Optimize data models, jobs, and workflows for performance and cost efficiency. Automate workflows using tools like Databricks Workflows , Airflow , or Azure Data Factory . Ensure data governance, quality, security, and compliance across platforms. Monitor, troubleshoot, and document data systems, pipelines, and operational metrics. Required Skills & Experience Bachelor's or Master's in Computer Science, Engineering, or related discipline. 4-8+ years of experience in data engineering with at least 2 years of hands-on experience in Databricks . Strong proficiency in Apache Spark (PySpark or Scala) and SQL . Hands-on experience with cloud platforms (Azure preferred, or AWS/GCP) and cloud data storage (ADLS, S3, GCS). Solid understanding of Delta Lake , data partitioning, schema evolution, and data lakehouse architecture. Experience with CI/CD pipelines , version control (Git), and Infrastructure as Code (e.g., Terraform). Strong grasp of data governance, lineage, and quality using tools like Unity Catalog , Great Expectations , or DataHub . Preferred Qualifications Experience with orchestration tools (Airflow, Azure Data Factory, Databricks Workflows). Familiarity with real-time data processing (Structured Streaming, Kafka). Working knowledge of containerization (Docker) and/or Kubernetes. Certifications: Databricks Certified Data Engineer Associate/Professional , Azure Data Engineer Associate , or equivalent.
Apply
Location:
OHIO CITY, OH, United States
Category:
Computer And Mathematical Occupations

We found some similar jobs based on your search