Data Engineer / Technical Data Specialist
New Today
Overview: GovCIO is actively seeking a dynamic Data Engineer (or Technical Data Specialist) to enhance our ETL Team, dedicated to designing, developing, and maintaining high-quality ETL pipelines and data infrastructure in AWS GovCloud environments. This opportunity offers a fully remote work arrangement.
Responsibilities:
Data Pipeline Development: Design and implement efficient Extract, Transform, Load (ETL) solutions that process and store data from diverse sources such as AWS S3, CloudWatch, EventBridge, and various cloud-based services.
Utilize AWS services including Lambda, Kinesis, and Data Prepper to construct scalable and high-performance data pipelines across numerous AWS accounts.
Employ AWS CloudFormation to manage and deploy data pipeline infrastructure in an Infrastructure-as-Code (IaC) setup.
Log Aggregation & Metrics Collection: Configure and deploy Fluent-bit agents for the collection of system and application logs from critical systems, transforming and routing logs with custom Lua functions and regex parsers as necessary.
Data Analysis, Visualization & Alerting: Create visualizations, dashboards, and alerts to monitor and identify anomalous system behavior. Set up CloudWatch alarms to oversee the health and performance of cloud applications and services.
Cluster Management & Data Storage: Maintain and manage an OpenSearch cluster for large-scale data ingestion and querying, implementing indexing and access control to ensure performance and security.
Application Performance Monitoring: Use OpenTelemetry to instrument applications for optimal insight into performance metrics.
Qualifications:
High School Diploma with 9+ years of relevant experience.
Top Secret clearance required.
IAT level II/III certification (e.g., CompTIA Security+(CE)) is essential.
Proven expertise in Linux and/or AWS GovCloud technologies.
Preferred Skills:
Strong knowledge of AWS services: Lambda, Kinesis, CloudWatch, S3, EventBridge, and CloudFormation.
Proficiency in Python for ETL processes.
Experience with distributed NoSQL databases such as OpenSearch or Elasticsearch.
Familiarity with Infrastructure-as-Code principles, particularly AWS CloudFormation.
Strong communication skills, both written and verbal.
Company Overview: At GovCIO, we are a team of innovators committed to transforming government IT. We actively seek out passionate individuals who want to make a significant impact on how government agencies operate and serve their citizens. Join us to be part of a forward-thinking culture that values diverse talents and fosters career growth.
Employee Perks: Our employees enjoy a variety of benefits that go beyond standard health coverage, such as:
Employee Assistance Program (EAP)
Corporate Discounts
Learning & Development platforms, including certification preparation support
Flexible Work Environment
Referral Bonus Program
If you are passionate about transforming government IT and are ready to take on a challenge, we encourage you to apply!
Location: Hanover, MD
- Location:
- Boise, ID, United States
- Category:
- Computer And Mathematical Occupations