Cpctechno
6 - 8 years of experience in developing data solutions using Python and Spark framework.
Job Description
Design, modify, and build scalable data processes. Perform root cause analysis and identify performance bottlenecks in Spark jobs. Expertise in data engineering, building data pipelines, and implementing algorithms in a distributed environment. Design and develop parallel processing data platforms in PySpark. Conduct data analysis to troubleshoot data-related issues and assist in their resolution. Strong proficiency in SQL. Knowledge of cloud platforms, especially Azure. Collaborate with stakeholders, IT teams, database engineers, and data scientists. Hands-on experience with Azure Synapse and Azure Data Factory is a plus.
#J-18808-Ljbffr
Design, modify, and build scalable data processes. Perform root cause analysis and identify performance bottlenecks in Spark jobs. Expertise in data engineering, building data pipelines, and implementing algorithms in a distributed environment. Design and develop parallel processing data platforms in PySpark. Conduct data analysis to troubleshoot data-related issues and assist in their resolution. Strong proficiency in SQL. Knowledge of cloud platforms, especially Azure. Collaborate with stakeholders, IT teams, database engineers, and data scientists. Hands-on experience with Azure Synapse and Azure Data Factory is a plus.
#J-18808-Ljbffr