Diverse Lynx
MUST HAVE: Scala, Java, Pyspark, Spark, BigQuery, Dataproc
• NICE TO HAVE: Event Engine, Cloud composer, Shell scripts, Hadoop(MapR), Hive, Scheduler
• Minimum 4+ years of experience in Implementing data migration program from Hadoop (On-prem) with Scala, Java, Python, Spark to GCP BigQuery, Dataproc
• Minimum experience of 4+ years in Integrating plugins for GitHub Action to CICD platform to ensure software quality and security.
• Experience of 4+ years on Google Cloud platform (GCP) tools mainly BigQuery, Dataproc, Cloud composer, Cloud storage, etc.,
• Minimum 4+ years of experience in Cloud Deployments.
• Configuring scripts in Cloud console / Jenkins for Automated executions
• Prior work experience in BFSI Warehouse functional domains will be an added advantage.
• Hands on experience on Pipeline creation with Scala scripts from scratch and troubleshooting cloud configuration issues.
• Should have worked on Git and Continuous Integration environment like GitHub action, Jenkins
• Should have experience SQLs, NoSQL Databases
• Should have experience in working in teams following Agile or XP methodology.
• Should have BFSI domain experience to understand the business requirement.
• Minimum 2+ years of Senior programming level experience involving some architecture and high-level design.
• Understanding of distributed systems and related concepts required.