Logo
ALTA IT Services

Data Engineer

ALTA IT Services, Arlington, Virginia, United States, 22201

Save Job

Job Description Title:

Data Engineer

Timeline

to Start: ASAP

Clearance:

TS/SCI required. CI Poly preferred

Worksite Address:

Crystal City, VA,

On-Site in SCIF

Work Schedule:

M-F 9-5 pm EST, Full-time 40 hours

Contact:

Cdinnocenti@altaits.com

Required Education

· Bachelor’s degree in data engineering, computer science, data science, or similar

Job Description:

ALTA IT is seeking a Senior Software/Data Engineer supporting Special Operations Command (SOCOM) on-site in Crystal City. The position involves providing big data ETL support on classified data and systems to directly support the client's mission. This position requires active Top Secret SCI Clearance, for which you must be a US citizen.

RESPONSIBILITIES WILL INCLUDE:

Design, develop, and implement scalable data pipelines and ETL processes using Apache Airflow

Implement and optimize Python-based data processing solutions.

Utilize Trino for distributed SQL query processing.

Develop messaging solutions utilizing Kafka to support real-time data streaming and event-driven architectures.

Build and maintain high-performance data retrieval solutions using ElasticSearch/OpenSearch.

Integrate batch and streaming data processing techniques to enhance data availability and accessibility.

Ensure adherence to security and compliance requirements when working with classified data

Work closely with cross-functional teams to define data strategies and develop technical solutions aligned with

MISSION OBJECTIVES

Deploy and manage cloud-based infrastructure to support scalable and resilient data solutions, including AWS S3.

Optimize data storage, retrieval, and processing efficiency, focusing on big data.

REQUIRED SKILLS

Bachelor’s degree or higher in data engineering, computer science, data science, or similar

At least 10 years of experience in software engineering, data engineering, or related work

Expert in Python with significant on the job experience

Advanced proficiency in SQL (especially Postgres and/or Trino) with significant on the job experience

Significant experience with big data technology and ETL

Experience with Airflow (or equivalent) as an ETL workflow technology

Significant experience creating scalable data pipelines with structured and unstructured data. Experience with AWS or equivalent cloud-based services (e.g. S3 or S3-like services)

Active TS/SCI Clearance, for which you must be a US citizen

DESIRED SKILLS

Experience with Postgres or Trino

Experience with Apache Iceberg, Hive, HDFS, or Spark

Experience with Kubernetes as an operating environment and Helm as infrastructure management

Previous DOD experience D (Especially Special and Joint Operations)

Active CI Poly

#J-18808-Ljbffr