HCL USAAvance Consulting
Databricks Engineer
HCL USAAvance Consulting, San Francisco, California, United States, 94199
As a Databricks Engineer, you will play a pivotal role in crafting and optimizing Microsoft Azure solutions to meet dynamic client needs. This position offers the opportunity to leverage your expertise in Azure technologies to drive impactful projects that align with the company's strategic objectives. Your work will significantly contribute to enhancing data-driven decision-making and operational efficiency across diverse business units.
DETAILED RESPONSIBILITIES: - Design and develop software solutions to implement innovative features and support existing applications. - Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory. - Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes. - Collaborate with the technical team to provide design and coding support, ensuring project deliverables are met. - Engage with clients to gather and interpret business requirements, translating them into actionable solutions.
SKILL REQUIREMENTS: - Demonstrated technical proficiency with the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS). - Expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. - Experience with ETL processes and strong analytical skills for report development. - Proficiency in relational databases and SQL language. - Bachelor's degree in Computer Science, Information Technology, or a related field.
OTHER REQUIREMENTS (OPTIONAL): - Experience with Python scripting and Spark APIs is highly desirable. - Previous experience in a client-facing role will be advantageous. - Familiarity with agile development methodologies and practices.
Mandatory Skills Required: - Microsoft Azure Stack - Azure Data Factory - Azure Databricks - Azure Synapse Analytics - Azure DevOps - Azure Storage/Data Lake - ETL Processes - Relational Databases and SQL
DETAILED RESPONSIBILITIES: - Design and develop software solutions to implement innovative features and support existing applications. - Ingest and integrate data from various source systems into the Azure Analytics Platform using Azure Databricks and Azure Data Factory. - Construct robust Azure Data Factory (ADF) pipelines to facilitate efficient data ingestion and transformation processes. - Collaborate with the technical team to provide design and coding support, ensuring project deliverables are met. - Engage with clients to gather and interpret business requirements, translating them into actionable solutions.
SKILL REQUIREMENTS: - Demonstrated technical proficiency with the Microsoft Azure Stack (T-SQL, SSIS, SSAS, SSRS). - Expertise in Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure DevOps, and Azure Storage/Data Lake. - Experience with ETL processes and strong analytical skills for report development. - Proficiency in relational databases and SQL language. - Bachelor's degree in Computer Science, Information Technology, or a related field.
OTHER REQUIREMENTS (OPTIONAL): - Experience with Python scripting and Spark APIs is highly desirable. - Previous experience in a client-facing role will be advantageous. - Familiarity with agile development methodologies and practices.
Mandatory Skills Required: - Microsoft Azure Stack - Azure Data Factory - Azure Databricks - Azure Synapse Analytics - Azure DevOps - Azure Storage/Data Lake - ETL Processes - Relational Databases and SQL