Logo
QTech

Azure Data Engineer

QTech, Irving, Texas, United States, 75084

Save Job

Job Title: Azure Data Engineer Location: Irving TX

Domain: Telecommunications

Long Term Contract

Looking for W2 Candidates. No C2C

Job Description Azure Data Engineer with strong development experience in Python and containerized environments. You’ll be building modular ETL pipelines using APIs and SQL in an Azure-native setup with a strong focus on data governance secure service account usage and automation. This role is perfect for someone passionate about scalable architecture and responsible data practices.

Key Responsibilities

Design and implement data ingestion pipelines using Python targeting JDBC / ODBC / API / Batch sources

Create and orchestrate Apache Airflow DAGs using modular / factory-based patterns

Build containerized solutions using Docker with local dev setups and AKS-based deployment strategies

Work with SQL Server (MI) to extract metadata, define classifications and manage access control

Use Microsoft Purview for classification tagging and metadata management

Configure and manage Azure resources (Blob Storage, Key Vault, Azure Monitor, Functions, AKS)

Develop and deploy using CI/CD pipelines via Azure DevOps

Apply access controls using service accounts adhering to minimum privilege principles and masking policies

Analyze audit logs and build dashboards for usage tracking and masking compliance

Write reusable code and documentation to support automation and knowledge transfer

Qualifications

5 years of hands‑on experience in data engineering with Python development

Strong in: Python (ETL scripting, logging, error handling)

SQL development and performance tuning

Azure ecosystem: AKS, Blob, Key Vault, Service Principles, Azure Monitor, etc.

REST APIs and ingestion from diverse sources

Docker and container lifecycle management

Service account management and data security enforcement

Familiar with Terraform, Git and modern CI/CD best practices

Understanding of data governance PII / PCI classification and compliance (SOX, GDPR, etc.)

Key Skills

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

#J-18808-Ljbffr