Data Engineer / Technical Data Specialist

New Today

Overview: GovCIO is actively seeking a dynamic Data Engineer (or Technical Data Specialist) to enhance our ETL Team, dedicated to designing, developing, and maintaining high-quality ETL pipelines and data infrastructure in AWS GovCloud environments. This opportunity offers a fully remote work arrangement. Responsibilities: Data Pipeline Development: Design and implement efficient Extract, Transform, Load (ETL) solutions that process and store data from diverse sources such as AWS S3, CloudWatch, EventBridge, and various cloud-based services. Utilize AWS services including Lambda, Kinesis, and Data Prepper to construct scalable and high-performance data pipelines across numerous AWS accounts. Employ AWS CloudFormation to manage and deploy data pipeline infrastructure in an Infrastructure-as-Code (IaC) setup. Log Aggregation & Metrics Collection: Configure and deploy Fluent-bit agents for the collection of system and application logs from critical systems, transforming and routing logs with custom Lua functions and regex parsers as necessary. Data Analysis, Visualization & Alerting: Create visualizations, dashboards, and alerts to monitor and identify anomalous system behavior. Set up CloudWatch alarms to oversee the health and performance of cloud applications and services. Cluster Management & Data Storage: Maintain and manage an OpenSearch cluster for large-scale data ingestion and querying, implementing indexing and access control to ensure performance and security. Application Performance Monitoring: Use OpenTelemetry to instrument applications for optimal insight into performance metrics. Qualifications: High School Diploma with 9+ years of relevant experience. Top Secret clearance required. IAT level II/III certification (e.g., CompTIA Security+(CE)) is essential. Proven expertise in Linux and/or AWS GovCloud technologies. Preferred Skills: Strong knowledge of AWS services: Lambda, Kinesis, CloudWatch, S3, EventBridge, and CloudFormation. Proficiency in Python for ETL processes. Experience with distributed NoSQL databases such as OpenSearch or Elasticsearch. Familiarity with Infrastructure-as-Code principles, particularly AWS CloudFormation. Strong communication skills, both written and verbal. Company Overview: At GovCIO, we are a team of innovators committed to transforming government IT. We actively seek out passionate individuals who want to make a significant impact on how government agencies operate and serve their citizens. Join us to be part of a forward-thinking culture that values diverse talents and fosters career growth. Employee Perks: Our employees enjoy a variety of benefits that go beyond standard health coverage, such as: Employee Assistance Program (EAP) Corporate Discounts Learning & Development platforms, including certification preparation support Flexible Work Environment Referral Bonus Program If you are passionate about transforming government IT and are ready to take on a challenge, we encourage you to apply! Location: Hanover, MD
Location:
Boise, ID, United States
Category:
Computer And Mathematical Occupations