Senior Data Architect

Key Responsibilities: End-to-end software solution design to development to implementation for any big projects / change request Support user query or address any performance issue either with Business users query response or system performance Key Requirements: Expertise in developing / implementing framework to build various data pipeline using (Pyspark, Scala, Java) Expertise in implementing Hadoop based Data mart using Spark based framework (Java, Scala, Pyspark) Good Working experience in core technical area using Python, Java, PySpark and Scala Expertise in Cloudera CDH / CDP components Good knowledge in developing Spark based ingestion framework (Java, Scala, Pyspark) Experience in building and operationalising feature pipeline to support AI/ML model execution, data pipelines for supporting large scale data warehouse/data marts Added advantage: • Scripting knowledge in Bash, Python and Perl, to automate and avoid repetitive tasks. • Possess good technical knowledge of RHEL/Linux, and Unix hardware, operating system and system services

#J-18808-Ljbffr