ETL Flow Engineer (1454)

Summary:

The ETL Flow Engineer is part of a skilled IT team that will work independently and collectively with other engineers to identify and test potential enhancements and resolve technical issues with the rapid scaling of an intelligence application.

Essential Functions:

• Perform software integration tasks, including scripting, systems analysis, requirements gathering, testing, and documentation. Provide support to technical writers and testers, manage configuration and system maintenance, utilize source code control to track and safeguard changes to the codebase, and apply software updates.
• Collaboratively design, develop, and implement custom ETL scripts while supporting software products as required. Ensure data quality, consistency, and integrity across the entire pipeline. Engage directly with customers to create ingestion feeds for unique systems, demonstrating the ability to devise solutions with minimal prior documentation or details about these systems.
• Perform infrastructure management functions, including designing, architecting, and implementing scalable infrastructure across multiple IC networks and application nodes using DevSecOps practices. Oversee containerization efforts with tools such as Docker and Podman, and manage orchestration processes. Upgrade and migrate applications to containerized environments to enable scalability and transition to a microservices architecture. Document infrastructure administration, including creation, management, and decommissioning procedures.

Qualifications:

• Knowledge of DevSecOps processes including Infrastructure as Code using Puppet or Ansible.
• Knowledge of containerization and container orchestration including networking using Docker, Podman, or Kubernetes.
• Experience with the full DataOps lifecycle including ingestion and ETL processes into databases.
• Linux System administration knowledge: know the Linux command line, service management, software configuration concepts in lieu of virtual machine constraints.
• Ability to convert data and fix malformed data. This requires an understanding of XML, JSON, and regular expressions.

Preferred Qualifications:

• Experience with All Source Intelligence reports standards such as USMTF and lifecycle requirements management development.
• Experience in NiFi data flow, from configuration to creating new flows and making new processors.
• Ability to write in JavaScript, Groovy, and Python within NiFi and Linux.

Certifications Required:

IAT Level III certification is required for this role

Education/Experience include:

A bachelor’s degree with 12 years of experience in performing similar or related work is required.

Clearance Type: 

TS//SCI clearance required.

Travel: 

Possible travel, less than 5%