Tata Consultancy Services
Overview
The Kafka Architect will be responsible for designing, implementing, and managing scalable, high-performance data streaming solutions using the Apache Kafka ecosystem, with a strong focus on Confluent Platform and Confluent Cloud. The role demands deep expertise in real-time data processing, event-driven architecture, and integration with modern cloud and data platforms. Responsibilities
Architect and implement enterprise-grade Kafka solutions using Confluent Platform/Cloud. Design and manage Kafka clusters, brokers, topics, and partitions for optimal performance and reliability. Lead migration efforts from legacy messaging systems (e.g., IBM MQ, TIBCO) to Kafka. Develop and optimize Kafka Streams, ksqlDB, Kafka Connect, and Flink-based pipelines. Ensure high availability, disaster recovery, and security (RBAC, ACLs) of Kafka infrastructure. Collaborate with data engineering, DevOps, and application teams to integrate Kafka into broader enterprise systems. Monitor and troubleshoot Kafka environments using tools like Grafana, Prometheus, and Confluent Control Center. Qualifications
8–10+ years of experience in Kafka architecture and implementation. Deep expertise in: Apache Kafka Confluent Platform / Confluent Cloud Kafka Connect, Kafka Streams, ksqlDB Zookeeper/KRaft Experience with cloud platforms (AWS, GCP, Azure) and CI/CD pipelines. Strong understanding of data integration tools (e.g., Snowflake, Databricks, Hadoop). Familiarity with scripting (Shell, Python) and infrastructure-as-code (Terraform). Financial services or credit union domain experience is highly preferred. Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Design, IT/Technology Industries: IT Services and IT Consulting Salary
Salary Range:
$140,000-$150,000 a year Benefits
Discretionary Annual Incentive Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans Family Support: Maternal & Parental Leaves Insurance Options: Auto & Home Insurance, Identity Theft Protection Conveneince & Professional Growth: Commuter Benefits & Certification & Training Reimbursement Time Off: Vacation, Time Off, Sick Leave & Holidays Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
#J-18808-Ljbffr
The Kafka Architect will be responsible for designing, implementing, and managing scalable, high-performance data streaming solutions using the Apache Kafka ecosystem, with a strong focus on Confluent Platform and Confluent Cloud. The role demands deep expertise in real-time data processing, event-driven architecture, and integration with modern cloud and data platforms. Responsibilities
Architect and implement enterprise-grade Kafka solutions using Confluent Platform/Cloud. Design and manage Kafka clusters, brokers, topics, and partitions for optimal performance and reliability. Lead migration efforts from legacy messaging systems (e.g., IBM MQ, TIBCO) to Kafka. Develop and optimize Kafka Streams, ksqlDB, Kafka Connect, and Flink-based pipelines. Ensure high availability, disaster recovery, and security (RBAC, ACLs) of Kafka infrastructure. Collaborate with data engineering, DevOps, and application teams to integrate Kafka into broader enterprise systems. Monitor and troubleshoot Kafka environments using tools like Grafana, Prometheus, and Confluent Control Center. Qualifications
8–10+ years of experience in Kafka architecture and implementation. Deep expertise in: Apache Kafka Confluent Platform / Confluent Cloud Kafka Connect, Kafka Streams, ksqlDB Zookeeper/KRaft Experience with cloud platforms (AWS, GCP, Azure) and CI/CD pipelines. Strong understanding of data integration tools (e.g., Snowflake, Databricks, Hadoop). Familiarity with scripting (Shell, Python) and infrastructure-as-code (Terraform). Financial services or credit union domain experience is highly preferred. Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Design, IT/Technology Industries: IT Services and IT Consulting Salary
Salary Range:
$140,000-$150,000 a year Benefits
Discretionary Annual Incentive Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans Family Support: Maternal & Parental Leaves Insurance Options: Auto & Home Insurance, Identity Theft Protection Conveneince & Professional Growth: Commuter Benefits & Certification & Training Reimbursement Time Off: Vacation, Time Off, Sick Leave & Holidays Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing
#J-18808-Ljbffr