Career Title: Senior Data Engineer
Department: Data Governance
Note: Competitive salary commensurate with data engineer experience
FLSA: Exempt (salaried)
Note: Union Dues are 1.44% of Bi-Weekly Pay
Career Summary:
The Data Governance team is seeking a highly skilled and experienced Senior Data Engineer to join our data and analytics team to build and maintain data infrastructure and data pipelines to enable analytics to include more advanced analytics and machine learning models. Manages and coordinates with internal or external parties the collection, compilation, normalization, and standard analysis of data assets across diverse projects and data platforms. Serves as a data subject matter expert, collaborates with business owners or external clients to establish an analysis plan to answer key business questions, and delivers both reporting results and insights. Generates specific and operational reports in support of objectives and initiatives and presents and communicates complex analytical data and results to appropriate audiences.
The ideal candidate will have 7 or more years of hands-on experience in designing and building scalable data pipelines, with deep expertise in Databricks, Apache Spark, and cloud-based data platforms (Azure, AWS, or GCP). The role requires strong proficiency in DevOps practices, including CI/CD automation, infrastructure as code, and monitoring of data workflows. This position will play a key role in optimizing our data architecture, enabling advanced analytics, and supporting data governance and security standards across the enterprise.
Join the American Nurses Enterprise (ANE) and be part of the team building a healthy world through the power of nurses. Our goals are to (1) Elevate the Profession of Nursing Globally
(2) Evolve the Practice of Nursing to Improve Health, Health Care, and Health Equity and (3) Ensure the Professional Success of Nurses. Our core values: Trusted, Inclusive, Innovative and Empowered guide everything we do. We are committed to creating a supportive and dynamic workplace where employees can thrive.
We understand the importance of work-life balance and offer flexible work arrangements and generous paid time off. Our modern office spaces are designed to foster collaboration and creativity. The collaborative culture and supportive team environment make ANE a great place to grow your career.
What You Will Do:
Design, build, and optimize scalable, high-performance data pipelines to support analytics, AI/ML, and business intelligence workloads.
Troubleshoot data pipeline failures, latency issues, and infrastructure bottlenecks, implementing proactive monitoring and alerting.
Lead the adoption of DevOps and automation practices, including CI/CD pipelines, Infrastructure as Code (IaC), and workflow orchestration.
Implement ETL/ELT solutions for efficient data ingestion, transformation, and integration from multiple sources.
Build and manage RESTful APIs to integrate data from various data sources with strong proficiency in handling OAuth authentication, JSON data parsing, and building scalable data pipelines.
Translate complex business requirements into technical solutions, ensuring alignment with enterprise data strategies.
Manage and optimize Azure cloud data storage solutions for cost and performance efficiency.
Ensure data quality, integrity, and consistency by implementing validation, monitoring and error-handling frameworks.
Evaluate and recommend emerging data technologies and architectures to enhance scalability, efficiency, and innovation.
Define and enforce data governance, security, and compliance policies, ensuring alignment with industry standards.
Optimize query performance, indexing, and partitioning strategies to enhance data accessibility and speed.
Collaborate with data architects, data analysts and business stakeholders to deliver data-driven solutions that support decision-making.
Mentor and provide technical guidance to junior data engineers, fostering a culture of best practices and continuous improvement.
Takes authority, responsibility, and accountability for exploiting the value of enterprise information assets and of the analytics used to render insights for decision making automated decisions and augmentation of human performance.
What you bring to the American Nurses Enterprise:
Education
• Bachelor’s degree in computer science, engineering, or related field.
Related Work Experience
• Seven (7+) plus years building enterprise-level data solutions on cloud platforms.
Skills
Primary expertise in Databricks, including Databricks Workflows for orchestrating scalable, production-grade data pipelines and ML workflows.
Advanced programming skills in Python and SQL for developing robust data engineering, analytics, and machine learning solutions.
Proficient in Apache Spark (PySpark) for large-scale distributed data processing and real-time analytics on big data platforms.
Experience in integrating data from social media platforms using RESTful APIs, with strong proficiency in handling OAuth authentication, JSON data parsing, and building scalable data pipelines.
Strong DevOps capabilities, including CI/CD pipeline design, automated deployments, and monitoring for data solutions using tools like Shelling Scripting, Azure DevOps, GitHub Actions, and Terraform.
Deep experience with data pipeline design (ETL/ELT), including structured streaming and batch ingestion, transformation, and orchestration using tools like Databricks, Airflow, and Kafka.
Proven expertise in working with relational (PostgreSQL, SQL Server) and NoSQL (MongoDB, Cassandra) databases, as well as data warehouse platforms such as Azure Synapse.
Experience in data governance frameworks, including data quality, lineage, cataloging, access control, and compliance with security and regulatory standards (e.g., GDPR, CCPA).
Experience implementing data quality controls, metadata management, and lineage tracking using Unity Catalog, Great Expectations, and custom rule-based validation frameworks.
Proficient in cloud-native data architectures, especially on Azure, leveraging services such as Azure Data Factory, Azure Key Vault, and Azure Monitor for end-to-end solution management.
Proven experience designing and managing the full machine learning lifecycle using tools such as MLflow, encompassing model deployment, performance tracking, and scalable retraining processes.
Familiarity with containerization and orchestration using Docker and Kubernetes for deploying scalable and portable data services is a plus.
Excellent collaborator with cross-functional teams including data scientists, business analysts, and IT, translating complex technical requirements into actionable, value-driven data solutions.
Strong analytical, debugging, and optimization skills for improving pipeline performance, data quality, and reliability.
Adept at aligning technical data solutions with business goals by understanding data sources, analytical objectives, and enterprise data strategy.
Preferred Skills & Experience
Experience in healthcare and nursing, manufacturing, supply chain or related domains.
Master’s degree in computer science or engineering, a plus. Knowledge of machine learning and AI.
What ANE Offers You:
Join us and support more than 5 million Registered Nurses in the United States.
Every role within ANA contributes to a healthier world through the “Power of Nurses.”
An opportunity to help transform a 129-year-old organization to meet the future needs and demands within Health Care.
Commitment to Diversity, Equity, Accessibility, and Belonging (DEIAB)
Be a role model for embracing and empowering the uniqueness of every employee.
Continuously innovating through creative and strategic initiatives.
Exceptional benefits including, but not limited to 401K retirement contributions of up to 7%, generous PTO which includes the week-off between Dec 25 and Jan 1, in addition to Personal Days-off, 11 paid Holidays, excellent health/medical benefits, and much more
Commitment to your career development and advancement through ANE learning and development programs (internally and externally).
Work Schedule:
Hybrid employees must work a minimum of 20% in the office.
Location:
Our main office is located at: 8403 Colesville Road, Suite 500, Silver Spring, MD 20910
Learn more about the American Nurses Enterprise:
https://www.nursingworld.org/ana -enterprise-jobs/
https://www.linkedin.com/company/american -nurses-association
The American Nurses Enterprise:
Founded in 1896, the American Nurses Enterprise is the family of nonprofit organizations that comprise of the American Nurses Association, including the American Nurses Association (ANA), the American Nurses Credentialing Center (ANCC), and the American Nurses Foundation (ANF)
Equal Opportunity Employer:
The ANE is an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, veteran status, or any other status protected under federal, state, or local law.