Big Data Platform / DevOps Engineer

Functional / Technical • Operating Global Data Platform components (VM Servers, Kubernetes, Kafka) and applications (Apache stack, Collibra, Dataiku and similar). • Implement automation of infrastructure, security components, and Continuous Integration & Continuous Delivery for optimal execution of data pipelines (ELT/ETL). • Develop solutions to build resiliency in data pipelines with platform health checks, monitoring, and alerting mechanisms, quality, timeliness, recency, and accuracy of data delivery are improved • Apply DevSecOps & Agile approaches to deliver the holistic and integrated solution in iterative increments. • Liaison and collaborate with enterprise security, digital engineering, and cloud operations to gain consensus on architecture solution frameworks. • Review system issues, incidents, and alerts to identify root causes and continuously implement features to improve platform performance. • Be current on the latest industry developments and technology trends to effectively lead and design new features/capabilities. Technical Skills •Bachelor's degree in Computer Science, Information Technology, or related field •At least 5 years of experience in big data engineering, with a focus on cloud-based infrastructure •Strong proficiency in: •DevOps tools like Jenkins, GitLab CI/CD, or similar •Containerization using Docker and Kubernetes •Apache Spark and big data processing •Real-time data integration using Apache Kafka •Distributed SQL engines like Presto and Trino •Data science platforms like Dataiku •Cloud-based object storage solutions like Amazon S3 •Ansible Playbooks to automate infrastructure provisioning, configuration, and deployment •Terraform to manage and provision cloud infrastructure resources •Experience with programming languages like Python •Experience with cloud migration, including assessment, planning, execution, and validation •Experience with disaster recovery setup, including backup and restore processes, replication, and failover mechanisms Professional Skills •Strong understanding of software development life cycles, Agile methodologies, and version control systems like Git •Excellent problem-solving skills, with the ability to analyse complex issues and develop creative solutions •Strong communication and collaboration skills, with experience working with cross-functional teams

#J-18808-Ljbffr