IT Role: Data Engineer III Location: AWG Support Center - Kansas Avenue Kansas City, KS Department: Information Technology Associated Wholesale Grocers (AWG) is transforming our business intelligence, analytics, and data automation capabilities. The goal is to level up data warehousing and data management capabilities, including curated and cleansed data sets, certified data models and sources. We are adapting to cloud-based data automation for data cleansing, extraction, loading, transformations and visualizations. Another goal is to expand storage and compute capacity for ingestion of structured and unstructured data. In addition, we are hardening security constraints, in the areas of role-based access, anonymized data sets and intrusion prevention constraints. As a Data Engineer III, you will play a pivotal role in the design, development, and optimization and support of a robust data ecosystem to support the company’s enterprise-wide business intelligence and analytics initiatives. Leveraging your experience in data engineering and visualization capabilities, you will be responsible for delivering enterprise data solutions, ensuring the adherence to data governance frameworks, and driving the development of scalable ETL processes. Your primary area of responsibility will be working on a strong data engineering which supports a new company-wide business intelligence and analytics environment. You will be performing the design, build deployment and support of standardized datasets derived from multiple systems of record. A key area of success for this role is developing or applying existing development and scripting skills in process automation to orchestrate data pipelines from business systems, data lakes and third-party data repositories and ability to visualize them. You will be creating and loading enterprise data warehouse/dimensional models that will be used for analysis and reporting. As you work on projects and enhancements you will assist in refining data governance within business processes and the technical tool chain, in addition to ensuring proper error/exception handling procedures are followed in the solutions. The ability to quickly learn the meaning of business data and understand the business domain is paramount to this role. Your skills will be leveraged to accurately identify key data and build the system processes which will extract, transform, load, and visualize the data that is used in key business decisions. This role includes hands-on development experience and participation in regular on-call duties. Position Responsibilities: Deliver Solutions (%) Architect, design and build real-time and batch data integrations from disparate source systems into the data lake/data warehouse. Write SQL, Pyspark, Python and Databricks Notebooks to orchestrate data movement and transformation from source to target, using parameterization whenever possible. Build and maintain scalable ETL processes using workflow automation tools such as Azure Data Factory, Azure Databricks, Cawa and Cleo Harmony Provide comprehensive documentation for installations and deliverables. Design enterprise grade data management solutions including dimensional models and be able to cleanse and transform raw data into structured format. Scale and tune data pipelines, data sets and SQL queries. Responsible for the full SDLC (Software Development Lifecyle) phases of Data Engineering to deliver enterprise grade data engineering solutions that meet the business current and future aspirations. This includes requirements gathering to warranty support including Unit testing, support of Integration testing and User Acceptance Testing. Understand dimensional modelling, importing, and cleaning/transforming/shaping using DAX & Power Query, Power BI Desktop and Service. Execute Azure DevOps CI/CD processes such as creating branches, merging to main, creating pull requests, getting approvals; Participate in CAB meetings, creating RFCs for migrating changes to Production. It would be nice to have knowledge of DABs (databricks asset bundles). Support & Availability Services (%) Participate in core/project team solving key/major production support issues, define/develop and execute data engineering optimizations based on the unknown/unexpected support issues. Participation in on call rotation for the data team to provide X coverage for the critical business systems is necessary. Work directly with Manager in communication planning, status reporting, issue notification and resolution. Take ownership of deliverables and ensure that they meet standards (including techniques for error/exception handling and restart ability) Contribute and implement data quality metrics and collaborate with data stewards. Develop and implement security mechanisms to protect data by using tools such as Active Directory groups, Azure Key Vault etc. Ensure that everyone has enough access to do their job, but not more access than necessary. Support traditional data science models including causal inference and predictive modeling with algorithms such as GBM, XGBoost. Diagnose and address issues like bias and variance. Productionize and deploy machine learning models, monitor their performance, and manage their lifecycle. Strategy – Align Roadmap & Strategy (%) Collaborate with business teams to identify data sources, models, business rules and data sets for analytical consumption (cross-functional collaboration) Develop data products using continuous deployment and automated data integration practices. Understand business requirements, understand the data in our various systems, and provide useful insights for solving a business problem through data analytics. Data aggregation, AI/ML models or Power BI may be used for data analytics. Team Development – Learning & Continuous Improvement (%) Partner with internal and external teams to deliver data solutions at its highest quality. Practice and contribute to the standard solution deliverable model. Contribute and follow defined data governance framework and enterprise data models. Participate with business in requirements gathering and understanding their needs and translating them into efficient data solutions. Requirements: Minimum - years of data engineering or related experience. Must be able to read/write SQL in the following environments (SQL Server, Oracle, DB). Must have completed at least one full cycle of building a data lake and/or a data warehouse. Experience working with one or more columnar storage systems (Snowflake, Redshift, Big query, etc). Experience working in cloud data environments (AWS, Azure). Knowledge and skills with Power BI will be important, not critical. Exposure to data streaming tools and technologies like Kafka, TensorFlow or similar. Ability to multi-task and change priorities. Strong business communications skills for requirements gathering and development. Previous Experience & Education: Bachelor’s degree in software engineering, computer science, computer information systems, or related degree, or experience. Minimum - years of Data Engineer experience. years overall data warehouse and/or data lake methodologies, and data solution deliveries. years of experience as a data engineer and/or software engineer. years of experience building ETL processes years of experience working with AWS or Azure workflow orchestration tools Knowledge & Skills: Experience working with SQL, RDBMS and Cloud technologies (Azure preferred, but AWS or GCP also will be considered). Proficiency in ETL processes, scripting and scheduling using tools such as ADF, Airflow Proficiency with Excel including building macros. Worked with or built Data Lakes, Data Warehouse in a hybrid environment (cloud / on-premises). Experience working with CRM systems like Salesforce. Experience with end-to-end supply chain or merchandising. Experience working in an IBM DB, SQL Server or Oracle environment. Experience working with Analytical Tools/Languages (SAS, Python, R, Spark, etc). Basic knowledge and understanding of statistics and awareness of data science methodologies Associated Wholesale Grocers, Inc. (AWG)  is the nation’s largest cooperative food wholesaler to independently owned supermarkets, serving , member companies and more than , locations throughout states from wholesale divisions. Consolidated sales for AWG in exceeded $ billion. In addition to its cooperative wholesale operations, the company also operates subsidiary companies that provide certain real estate and supermarket development services, and pharmaceutical products. For more information, visit . Benefits: Medical, Dental, & Vision Insurance

Health Savings Account

Dependent Care Flexible Spending Account

Paid Vacation, Holiday, and Sick Time

(k) with % match along with other contributions

Tuition Reimbursement

Basic & Supplemental Life and AD&D

Employee Assistance Program

Short-Term and Long-Term Disability

Wellness Program

Yearly Holiday Bonus