Ness Digital Engineering
MRC Confluent Kafka Senior Architect
Ness Digital Engineering, Chicago, Illinois, United States, 60290
Ness is seeking a DevOps Architect with expertise in Confluent Kafka (MRC/CFK) and Kubernetes. The candidate will be responsible for demonstrating the ability to run all clearing and risk systems through an internal datacenter (‘On-Prem’) and switch all production functionalities within predefined SLAs. The role involves working with scalable, cloud-based, and hybrid environments, utilizing AWS and multi-region disaster recovery strategies.
Responsibilities include:
Setting up CI/CD pipelines for application deployment in Kubernetes Configuring Confluent Kafka (MRC or CFK) across all regions in hybrid environments Setting up Rancher and downstream Kubernetes clusters across multiple environments and regions Automating Kafka cluster deployments with IaC pipelines using TFE and Ansible Automating Rancher and Kubernetes cluster deployments with IaC pipelines Building shared infrastructure services for on-premises failover environments, including S3, Kafka, and Data Store Establishing connectivity between new failover shared services and existing services like Secrets, Identity, DNS, and CI/CD tools Automating disaster recovery strategies, including data replication between Cloud and on-prem environments Continuously improving DevOps processes and team capabilities Developing solutions for complex technical challenges, including coding, testing, troubleshooting, and documenting Must have skills:
Extensive experience with CI/CD tools like Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness Deployment of applications on Kubernetes using Rancher, Helm, and Harness Deployment and management of Kafka (MRC or CFK) and monitoring tools like LogicMonitor and Splunk Experience with AWS and hybrid environments, including S3 replication with Cloudian Kubernetes administration skills: Helm, CRDs, K8 Operators, PVCs Confluent Kafka administration: Kafka, Zookeeper, Kafka Connect, monitoring, cluster management Knowledge of backup solutions for Kafka and Kubernetes Experience with Rancher RKE2, cluster management, and orchestration Object storage management with S3/Cloudian Experience with cloud infrastructure modernization, virtualization, and data center operations Hands-on scripting experience with Python or similar languages Monitoring and operational tools integration expertise Experience with microservices deployment in hybrid cloud/on-prem environments Intermediate knowledge of development tools like Maven/Gradle, Java, and message brokers like Kafka, RabbitMQ, Kinesis Nice to have:
Experience setting up CI/CD pipelines for streaming Flink applications Ness Digital Engineering seeks a professional with 15+ years’ experience as a DevOps Architect to lead AWS cloud, VMWare infrastructure, and DevSecOps services, focusing on innovation, core competencies, and capability building across regions.
Job requirements include:
Designing and managing enterprise networking and data center operations on AWS and VMware Developing future architecture blueprints for network security and shared infrastructure Establishing enterprise standards for infrastructure and security Overseeing security measures across networks, infrastructure, and applications Guiding customers in adopting compute, network, storage, and security services Collaborating with teams to integrate security and reliability into development processes Communicating with management on security and reliability initiatives Promoting automation and DevOps best practices in data center management Building relationships with senior technical executives and guiding technical teams Setting goals, conducting reviews, and providing feedback to technical teams Working with clients to explore business improvement opportunities and ROI-focused initiatives Ensuring compliance with standards and regulations Driving operational improvements to enhance system reliability
#J-18808-Ljbffr
Responsibilities include:
Setting up CI/CD pipelines for application deployment in Kubernetes Configuring Confluent Kafka (MRC or CFK) across all regions in hybrid environments Setting up Rancher and downstream Kubernetes clusters across multiple environments and regions Automating Kafka cluster deployments with IaC pipelines using TFE and Ansible Automating Rancher and Kubernetes cluster deployments with IaC pipelines Building shared infrastructure services for on-premises failover environments, including S3, Kafka, and Data Store Establishing connectivity between new failover shared services and existing services like Secrets, Identity, DNS, and CI/CD tools Automating disaster recovery strategies, including data replication between Cloud and on-prem environments Continuously improving DevOps processes and team capabilities Developing solutions for complex technical challenges, including coding, testing, troubleshooting, and documenting Must have skills:
Extensive experience with CI/CD tools like Jenkins, Artifactory, Confluent CFK, Kubernetes, Vault, SonarQube, GitHub, Terraform, Ansible, Rancher, and Harness Deployment of applications on Kubernetes using Rancher, Helm, and Harness Deployment and management of Kafka (MRC or CFK) and monitoring tools like LogicMonitor and Splunk Experience with AWS and hybrid environments, including S3 replication with Cloudian Kubernetes administration skills: Helm, CRDs, K8 Operators, PVCs Confluent Kafka administration: Kafka, Zookeeper, Kafka Connect, monitoring, cluster management Knowledge of backup solutions for Kafka and Kubernetes Experience with Rancher RKE2, cluster management, and orchestration Object storage management with S3/Cloudian Experience with cloud infrastructure modernization, virtualization, and data center operations Hands-on scripting experience with Python or similar languages Monitoring and operational tools integration expertise Experience with microservices deployment in hybrid cloud/on-prem environments Intermediate knowledge of development tools like Maven/Gradle, Java, and message brokers like Kafka, RabbitMQ, Kinesis Nice to have:
Experience setting up CI/CD pipelines for streaming Flink applications Ness Digital Engineering seeks a professional with 15+ years’ experience as a DevOps Architect to lead AWS cloud, VMWare infrastructure, and DevSecOps services, focusing on innovation, core competencies, and capability building across regions.
Job requirements include:
Designing and managing enterprise networking and data center operations on AWS and VMware Developing future architecture blueprints for network security and shared infrastructure Establishing enterprise standards for infrastructure and security Overseeing security measures across networks, infrastructure, and applications Guiding customers in adopting compute, network, storage, and security services Collaborating with teams to integrate security and reliability into development processes Communicating with management on security and reliability initiatives Promoting automation and DevOps best practices in data center management Building relationships with senior technical executives and guiding technical teams Setting goals, conducting reviews, and providing feedback to technical teams Working with clients to explore business improvement opportunities and ROI-focused initiatives Ensuring compliance with standards and regulations Driving operational improvements to enhance system reliability
#J-18808-Ljbffr