Logo
Request Technology, LLC

Lead Kafka Middleware Engineer

Request Technology, LLC, Chicago, Illinois, United States, 60290

Save Job

Overview

Prestigious Financial Institution is currently seeking a Lead Kafka Middleware Engineer with deep expertise in Kafka administration, infrastructure as code (IaC), cloud automation, container orchestration and CI/CD pipelines. The ideal candidate will be responsible for designing, implementing, and maintaining robust and scalable middleware solutions, ensuring high availability, performance, and security. The candidate will play a crucial role in automating infrastructure provisioning, deployments, and operations to rapidly deliver and scale applications. Responsibilities

Design, implement and manage highly available and scalable Kafka clusters. Monitor Kafka performance, troubleshoot issues and optimize configurations. Develop and maintain IaC using Ansible and Terraform for infrastructure provisioning and configuration management. Create and maintain reusable IaC modules. Design and implement cloud-based infrastructure solutions on AWS and Azure. Automate cloud resource provisioning, scaling and management using cloud-native tools and services. Deploy and manage containerized applications using Kubernetes and Rancher. Troubleshoot container-related issues and optimize container performance. Design, implement and maintain CI/CD pipelines using tools like GitHub, Artifactory, Harness and Jenkins. Automate the build, test and deployment of middleware components. Integrate IaC and container technologies into CI/CD pipelines. Document all processes and procedures. Work with development teams to ensure smooth deployments. Qualifications

Strong proficiency in IaC tools, specifically Ansible, Terraform and bash scripting. Extensive experience with cloud automation and provisioning on AWS and Azure. Proficiency in CI/CD tools, including GitHub, Artifactory, Harness and Jenkins. Strong scripting skills in languages like Python and Bash. Excellent troubleshooting and problem-solving skills. Understanding of networking principles. Experience with monitoring tools like Splunk, Splunk OTEL, Prometheus and Grafana. Bachelors degree in Computer Science, Engineering or a related field (or equivalent experience). 10+ years of experience in infrastructure middleware administration. In-depth expertise in Kafka administration, including cluster management, performance tuning, and security. AWS Solutions Architect, CKAD or CKA certifications preferred. Seniority level

Mid-Senior level Employment type

Full-time Job function

Information Technology Get notified about new Middleware Engineer jobs in

Chicago, IL .

#J-18808-Ljbffr