Fuel Data Engineer (SME), McLean Duties and Responsibilities:

Create and maintain a data pipeline architecture

Assemble large, complex sets of data that meet mission requirements

Identify, design, and implement improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes

Build required infrastructure for optimal extraction, transformation, and loading of data from various data sources using AWS, SQL, NiFi technologies

Build analytical tools to utilize the data pipeline, providing actionable insights into data performance including operational efficiency and customer acquisition

Work with mission stakeholders and assist them with data-related technical issues

Collaborate with technology stakeholders to support their data infrastructure needs while assisting with data-related technical issues

Skills and Experience:

Ability to build and optimize data sets, 'big data' data pipelines, and architectures

Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions

Excellent analytical skills related to working on unstructured datasets

Ability to build processes supporting data transformation, workload management, data structures, dependencies, and metadata

Bachelor’s degree in information systems, informatics, statistics, or computer science/software engineering

Minimum of five years of experience using software and tools such as:

Big data tools like Kafka, Spark, and Hadoop

Relational, NoSQL, and SQL databases including Cassandra and PostgreSQL

Workflow management and pipeline tools such as Airflow, Luigi, and Azkaban

AWS services including Redshift, RDS, EMR, and EC2

Stream-processing systems like Spark-Streaming and Storm

Object-oriented scripting languages including Scala, C++, Java, and Python

Data workflow orchestration tools like Pentaho or Apache NiFi

About Fuel

Fuel Consulting LLC helps clients create the path to their future. Clients gain expertise that requires no ramp-up time to deliver best practices, customized tools, and methodologies to help them achieve their vision and leave a legacy. If helping others and working with a team of talented individuals excites you, then Fuel is the place for you. Fuel offers...

#J-18808-Ljbffr