Logo
UST

Data Engineer

UST, Atlanta, Georgia, United States, 30383

Save Job

Position Title Data Engineer, Lead II - Data Engineering

Location Georgia

Compensation $76,500-$112,500

Responsibilities

Architect, build, and maintain scalable and reliable data pipelines using AWS and distributed processing frameworks.

Develop ETL/ELT processes using Python, PySpark, and AWS services such as Glue and Lambda.

Implement workflow orchestration using Airflow and AWS-native automation tools.

Optimize data storage, querying, and processing using Athena and other AWS analytics services.

Create and manage infrastructure-as-code components with Terraform (basic proficiency expected).

Work closely with data architects, analysts, and application teams to deliver robust data solutions.

Ensure best practices for data quality, security, governance, and monitoring across the data ecosystem.

Qualifications

AWS Lambda

AWS Glue

PySpark

Python

Airflow

Athena

Terraform (Basic)

Good-to-Have Skills: AWS Step Functions, DynamoDB

Nice-to-Have Skills: ECS, EKS, OpenSearch, Kinesis, SNS/SQS, Lake Formation

Preferred Experience: Building & optimizing data lakes and real-time/streaming data solutions; cloud-native architectures with automation; CI/CD pipelines for data engineering workloads; distributed systems & performance tuning.

Benefits Full‑time employees accrue paid vacation, sick leave, holidays, bereavement leave, and are eligible for 401(k) matching. Medical, dental, vision, and additional benefit options are available. Part-time and temporary employees receive proportional benefits.

Equal Employment Opportunity UST is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristics protected by law. UST will consider qualified applicants with arrest or conviction records in accordance with state and local laws and "fair chance" ordinances. UST reserves the right to periodically redefine roles based on organizational requirements and/or performance.

#J-18808-Ljbffr