Logo
R2 Technologies

Senior PySpark/Data Bricks

R2 Technologies, Alpharetta, Georgia, United States, 30239

Save Job

Senior PySpark/Data Bricks

Remote opportunity

We are looking for a highly qualified senior Pyspark/DataBricks Developer with the following qualifications:

The developer must have sound knowledge in Apache Spark and Python programming Good knowledge on ADLS Azure Blob Storage Azure Data Factory Azure Functions Synapse DW Azure SQL DB Event Hub SQL Databricks etc Build large scale batch and data pipelines with data processing frameworks in Azure or AWS cloud platform Developing highly scalable highly performant instrumented and accurate data pipelines Deep experience in developing data processing data manipulation tasks using PySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations Strong analytical problem solving and unit testing skills Experience in deployment and operationalizing the code is added advantage Experience:

Up to 4-7 years of working experience in Databricks Python Spark Scala The developer must have sound knowledge in Apache Spark and Python programming Deep experience in developing data processing tasks using pySpark such as reading data from external sources merge data perform data enrichment and load in to target data destinations Experience in deployment and operationalizing the code is added advantage

Skills:

Spark,Databricks,PySpark