Reveille Technologies
Hi There,
Job Title: Data Engineer/ Power BI Consultant
Location: Houston, TX (Need local Candidate)
Work Mode: Contract / Hybrid
Job Summary:
We are seeking a skilled and motivated
Data Engineer
with expertise in Python, PySpark, Data Lakes, Synapse Analytics, Azure Data Factory, and Medallion Architecture. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and data platforms in the Azure cloud ecosystem, and delivering insights via Power BI dashboards and reports. Key Responsibilities: Design, develop, and manage scalable data pipelines using
Python
and
PySpark . Implement and maintain
data lake architectures
(Delta Lake / Lakehouse) based on
Medallion Architecture
(Bronze, Silver, Gold layers). Utilize
Azure Synapse Analytics
to perform big data processing, data integration, and advanced analytics. Build and orchestrate ETL/ELT workflows using
Azure Data Factory . Integrate data from various sources (structured, semi-structured, unstructured) into a centralized
Data Warehouse . Ensure high data quality and implement robust data validation and monitoring frameworks. Work closely with BI developers and analysts to design effective
Power BI
dashboards and reports. Optimize performance of large-scale data solutions for real-time and batch processing workloads. Maintain and enforce data security, compliance, and governance across the platform. Required Skills and Experience: Strong programming skills in
Python
with experience in data engineering tasks. Hands-on experience with
PySpark
for distributed data processing on big data platforms. Proficiency in
Azure Synapse Analytics , including dedicated and serverless SQL pools. Solid understanding of
Azure Data Lake Storage Gen2
and
data lake design principles . Experience in building ETL/ELT pipelines with
Azure Data Factory (ADF) . Deep knowledge of
Medallion Architecture
(Bronze, Silver, Gold layers) and
Delta Lake
format. Strong SQL skills for querying and transforming data in
Data Warehouses . Experience designing, building, and publishing
Power BI
reports and dashboards. Familiarity with data governance, metadata management, and data lineage. Excellent communication, documentation, and collaboration skills.
Data Engineer
with expertise in Python, PySpark, Data Lakes, Synapse Analytics, Azure Data Factory, and Medallion Architecture. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and data platforms in the Azure cloud ecosystem, and delivering insights via Power BI dashboards and reports. Key Responsibilities: Design, develop, and manage scalable data pipelines using
Python
and
PySpark . Implement and maintain
data lake architectures
(Delta Lake / Lakehouse) based on
Medallion Architecture
(Bronze, Silver, Gold layers). Utilize
Azure Synapse Analytics
to perform big data processing, data integration, and advanced analytics. Build and orchestrate ETL/ELT workflows using
Azure Data Factory . Integrate data from various sources (structured, semi-structured, unstructured) into a centralized
Data Warehouse . Ensure high data quality and implement robust data validation and monitoring frameworks. Work closely with BI developers and analysts to design effective
Power BI
dashboards and reports. Optimize performance of large-scale data solutions for real-time and batch processing workloads. Maintain and enforce data security, compliance, and governance across the platform. Required Skills and Experience: Strong programming skills in
Python
with experience in data engineering tasks. Hands-on experience with
PySpark
for distributed data processing on big data platforms. Proficiency in
Azure Synapse Analytics , including dedicated and serverless SQL pools. Solid understanding of
Azure Data Lake Storage Gen2
and
data lake design principles . Experience in building ETL/ELT pipelines with
Azure Data Factory (ADF) . Deep knowledge of
Medallion Architecture
(Bronze, Silver, Gold layers) and
Delta Lake
format. Strong SQL skills for querying and transforming data in
Data Warehouses . Experience designing, building, and publishing
Power BI
reports and dashboards. Familiarity with data governance, metadata management, and data lineage. Excellent communication, documentation, and collaboration skills.