Senior Software Engineer - GCP Data Engineer
12 Days Old
Your Role
As a GCP Engineer, contribute to the migration of legacy data warehouse to a Google Cloud-based data warehouse for a Telecom Major.Collaborate with Data Product Managers and Data Architects to design, implement, and deliver successful data solutions.
Help architect data pipelines for the underlying data warehouse and data marts. Design and develop very complex ETL pipelines in Google Cloud Data environments.Our legacy tech stack includes Teradata and the new tech stack includes GCP Cloud Data Technologies like BigQuery and Airflow. Languages include SQL and Python.Maintain detailed documentation of your work and changes to support data quality and data governance.Support QA and UAT data testing activities. Support deployment activities to higher environments.Ensure high operational efficiency and quality of your solutions to meet SLAs and support commitment to our customers (Data Science, Data Analytics teams).Be an active participant and advocate of agile/scrum practice to ensure health and process improvements for your team.
Basic Qualifications
8 years of data engineering experience developing large data pipelines in very complex environments
Very strong SQL skills and ability to build very complex transformation data pipelines using custom ETL framework in Google BigQuery environment
Exposure to Teradata and ability to understand complex Teradata BTEQ scripts
Strong Python programming skills
Strong skills on building Airflow jobs and debugging issues
Ability to optimize queries in BigQuery
Hands-on experience on Google Cloud data technologies (GCS, BigQuery, Dataflow, Pub/Sub, Data Fusion, Cloud Function)
Preferred Qualifications
Experience with cloud data warehouse technology BigQuery
Nice to have experience with Cloud technologies like GCP (GCS, Data Proc, Pub/Sub, Data Flow, Data Fusion, Cloud Function)
Nice to have exposure to Teradata
Solid experience with job orchestration tools like Airflow and ability to build complex jobs
Writing and maintaining large data pipelines using custom ETL framework
Ability to automate jobs using Python
Familiarity with data modeling techniques and data warehousing standard methodologies and practices
Very good experience with code version control repository like GitHub
Good scripting skills, including Bash scripting and Python
Familiar with Scrum and Agile methodologies
Problem solver with strong attention to detail and excellent analytical and communication skills
Ability to work in Onsite/Offshore model and able to lead a team
Life at Capgemini
Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:
Flexible work
Healthcare including dental, vision, mental health, and well-being programs
Financial well-being programs such as 401(k) and Employee Share Ownership Plan
Paid time off and paid holidays
Paid parental leave
Family building benefits like adoption assistance, surrogacy, and cryopreservation
Social well-being benefits like subsidized back-up child/elder care and tutoring
Mentoring, coaching and learning programs
Employee Resource Groups
Disaster Relief
About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to
engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2024 global revenues of €22.1 billion.
Get the future you want | www.capgemini.com
Disclaimer
Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodations do not pose an undue hardship.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.
Click the following link for more information on your rights as an Applicant http://www.capgemini.com/resources/equal-employment-opportunity-is-the-law
Applicants for employment in the US must have valid work authorization that does not now and/or will not in the future require sponsorship of a visa for employment authorization in the US by Capgemini.
Job: Programmer/Analyst
Organization: I&D
Title: Senior Software Engineer - GCP Data Engineer
Location: GA-Atlanta
Requisition ID: 080862
- Location:
- Atlanta, GA, United States
- Category:
- Computer And Mathematical Occupations
We found some similar jobs based on your search
-
8 Days Old
Senior Software Engineer - GCP Data Engineer
-
Atlanta, GA, United States
- Computer And Mathematical Occupations
Your Role As a GCP Engineer, contribute to the migration of legacy data warehouse to a Google Cloud-based data warehouse for a Telecom Major.Collaborate with Data Product Managers and Data Architects to design, implement, and deliver successful data ...
More Details -
-
12 Days Old
Senior Software Engineer - GCP Data Engineer
-
Atlanta, GA, United States
- Computer And Mathematical Occupations
Your Role As a GCP Engineer, contribute to the migration of legacy data warehouse to a Google Cloud-based data warehouse for a Telecom Major.Collaborate with Data Product Managers and Data Architects to design, implement, and deliver successful data...
More Details -