Senior Databricks Data Engineer - Consulting Role
New Yesterday
At EY, we are dedicated to empowering your career and enabling you to shape a better working world with a team that values diversity and collaboration.
Technology - Data and Decision Science - Data Engineering - Senior Consultant
We are seeking a talented Senior Consultant Data Engineer with a specialization in cloud data engineering, particularly utilizing Databricks. The ideal candidates will possess exceptional client management abilities and communication skills, along with a proven track record in executing successful data engineering projects.
Your Role
In this dynamic position, you will design and build analytics solutions that deliver significant business value. Working closely with other data professionals and stakeholders, you will ensure that technical requirements align with business objectives, crafting scalable data architecture and modeling solutions that support the entire data lifecycle.
Key Responsibilities
Design and construct scalable data architecture on-premises or in the cloud.
Translate business requirements into comprehensive technical specifications.
Optimize data flows to align with target data platform designs.
Develop and implement data engineering solutions using Databricks across cloud platforms (AWS, Azure, GCP).
Engage with clients to fully understand their data needs and deliver tailored solutions.
Lead the end-to-end development of data pipelines, including ingestion, transformation, and storage processes.
Ensure the highest levels of data quality, integrity, and security throughout the data lifecycle.
Mentor junior data engineers and guide team members.
Effectively communicate complex data concepts to stakeholders at all levels.
Manage client relationships to guarantee high satisfaction and engagement.
Stay informed about the latest trends in data engineering and cloud computing.
This position provides a unique opportunity to work with cutting-edge technologies and keep ahead of industry innovations, offering a competitive advantage in the marketplace. Expect occasional travel to meet with external clients.
Skills and Attributes for Success
To excel in this position, you must possess a blend of technical expertise and soft skills, particularly the ability to communicate effectively and build robust relationships. Key attributes include:
Strong analytical and decision-making capabilities.
Expertise in cloud computing and data architecture design.
Experience with data integration and security practices.
A strong aptitude for solving complex challenges.
Qualifications Required
A Bachelor’s degree in Computer Science, Engineering, or a related field; a Master’s degree is preferred.
A minimum of 2-4 years of experience in data engineering, focusing on cloud solutions.
5+ years of experience in the data engineering domain, emphasizing cloud solutions.
Proficiency in Databricks and hands-on experience with Spark for big data processing.
Demonstrated success in at least two end-to-end data engineering implementations.
Strong programming skills in Python, Scala, or SQL.
Experience with data modeling, ETL processes, and data warehousing principles.
Proven problem-solving skills, with the ability to work both independently and collaboratively within a team.
Excellent communication skills, particularly in client management.
Required Expertise for Senior Consulting Projects
Strategic Thinking: Ability to align data solutions with overarching business strategies.
Project Management: Experience managing multiple projects to ensure timely delivery and adherence to scope.
Stakeholder Engagement: Proficient in engaging with stakeholders to grasp their requirements and present effective solutions.
Change Management: Skills in guiding clients through data transformation initiatives.
Risk Management: Capacity to identify and mitigate potential risks associated with data projects.
Technical Leadership: Experience in leading discussions and making impactful decisions.
Documentation and Reporting: Capable of generating detailed documentation and reports for clients.
Additional Preferred Qualifications
Experience with data quality management practices.
Familiarity with semantic layers in data architecture.
Experience with various cloud platforms (AWS, Azure, GCP) and their associated data services.
Understanding of data governance and compliance standards.
Familiarity with machine learning frameworks and tools.
What We Value
We seek adaptable, collaborative individuals who are committed to excellence in their work.
What We Offer
Join EY and benefit from a comprehensive compensation and benefits package. Your contributions will be recognized, and you will experience a culture that promotes professional growth and flexibility.
Competitive base salary range (US locations): $106,900 to $176,500. For specific areas like New York City Metro, Washington State, and California: $128,400 to $200,600.
Hybrid work model, with expectations of in-person collaboration 40-60% of the time.
Flexible vacation policy empowering you to manage your time off based on personal needs.
Ready to elevate your career? Apply today to be part of our mission in shaping a better working world.
We uphold high ethical standards and expect all candidates to share these values.
EY | Building a better working world
- Location:
- Detroit
- Category:
- Computer And Mathematical Occupations