Techstra Solutions
Job Description: Senior Azure Data Engineer at Techstra
Techstra is seeking an experienced Sr Azure Data Engineer with a minimum of 4-7 years' experience (e.g., Data warehouse design, business intelligence reporting, and Customer Information Systems) or, in lieu of experience, 6-9 years of an equivalent combination of education and work experience. From the day you join, you will hit the ground running surrounded by amazing people. Here are some of the expectations and responsibilities for this position: Responsibilities:
Design, test, and build scalable ETL/ELT/Data pipelines using Databricks, producing Data Products that support strategic priorities for our clients. Integrate Databricks with cloud services. Ingest structured and unstructured data from multiple sources (e.g., Kafka, REST APIs, databases, and cloud storage). Write optimized Spark SQL or PySpark code for batch and streaming data transformations. Implement data cleansing, validation, and enrichment processes. Optimize jobs for performance, memory management, and cost-efficiency. Develop technical and procedural documentation as required. Experience & Qualifications:
Proficiency in Databricks Platform, including notebooks, Unity Catalog, and MLflow. Deep understanding of Spark core concepts (RDDs, DataFrames, Spark SQL, Spark Streaming). Experience in performance tuning and optimization of Spark jobs. Programming skills in Python (PySpark), SQL, and optionally Scala or Java. Experience designing and implementing ETL/ELT pipelines with structured and unstructured data. Knowledge of Collibra integration. Experience with DevOps & CI/CD tools like Git, Azure DevOps, or GitHub Actions. Skills in data modeling, warehousing, and BI tools (Power BI, Tableau). Understanding of lakehouse architecture. Knowledge of security and governance practices, including RBAC, data masking, and audit logging. Strong communication and collaboration skills, especially in cross-functional teams. Experience writing technical design specifications and problem-solving skills. Familiarity with Scrum development methodology. At Techstra Solutions, we help top companies and brands achieve digital and talent transformation through a holistic approach integrating business strategy, technology, and human capital management. Additional Details:
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: Financial Services, Software Development, Technology, Internet Referrals increase your chances of interviewing at Techstra Solutions by 2x. Apply now to set job alerts for “Data Engineer” roles in Chicago, IL, with salary ranges from $85,000 to $209,109 annually.
#J-18808-Ljbffr
Techstra is seeking an experienced Sr Azure Data Engineer with a minimum of 4-7 years' experience (e.g., Data warehouse design, business intelligence reporting, and Customer Information Systems) or, in lieu of experience, 6-9 years of an equivalent combination of education and work experience. From the day you join, you will hit the ground running surrounded by amazing people. Here are some of the expectations and responsibilities for this position: Responsibilities:
Design, test, and build scalable ETL/ELT/Data pipelines using Databricks, producing Data Products that support strategic priorities for our clients. Integrate Databricks with cloud services. Ingest structured and unstructured data from multiple sources (e.g., Kafka, REST APIs, databases, and cloud storage). Write optimized Spark SQL or PySpark code for batch and streaming data transformations. Implement data cleansing, validation, and enrichment processes. Optimize jobs for performance, memory management, and cost-efficiency. Develop technical and procedural documentation as required. Experience & Qualifications:
Proficiency in Databricks Platform, including notebooks, Unity Catalog, and MLflow. Deep understanding of Spark core concepts (RDDs, DataFrames, Spark SQL, Spark Streaming). Experience in performance tuning and optimization of Spark jobs. Programming skills in Python (PySpark), SQL, and optionally Scala or Java. Experience designing and implementing ETL/ELT pipelines with structured and unstructured data. Knowledge of Collibra integration. Experience with DevOps & CI/CD tools like Git, Azure DevOps, or GitHub Actions. Skills in data modeling, warehousing, and BI tools (Power BI, Tableau). Understanding of lakehouse architecture. Knowledge of security and governance practices, including RBAC, data masking, and audit logging. Strong communication and collaboration skills, especially in cross-functional teams. Experience writing technical design specifications and problem-solving skills. Familiarity with Scrum development methodology. At Techstra Solutions, we help top companies and brands achieve digital and talent transformation through a holistic approach integrating business strategy, technology, and human capital management. Additional Details:
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: Financial Services, Software Development, Technology, Internet Referrals increase your chances of interviewing at Techstra Solutions by 2x. Apply now to set job alerts for “Data Engineer” roles in Chicago, IL, with salary ranges from $85,000 to $209,109 annually.
#J-18808-Ljbffr