Luxoft_Senior Data Engineer / Developer (AWS)

The Senior Data Engineer will design, build, and optimize large-scale data infrastructure, ensuring efficient data collection, processing, and availability to support advanced analytics and data-driven decision-making.

Role Description

Design ETL/ELT pipelines for network telemetry data

Interface with on-premises data collection systems

Implement Iceberg table structures, also for time-series data

Optimize data processing for analytics

Manage data quality and lineage

Implement pipeline observability

Implement modern data protection strategies

Qualifications

5 years experience with AWS Glue, S3, Athena, IAM, Lakeformation, Lambda, S3 Tables

Apache Iceberg and lakehouse architectures

Java (Python, Scala) for data processing

Familiarity with data formats (JSON, Avro, Parquet)

Time-series database queires

Data processing (Spark, DuckDB, Flink, AirFlow, Prefect)

Graph Theory

Excellent SQL Knowledge

English: B1

Nice to Have

AWS Certifications

#J-18808-Ljbffr