TCS USAAvance Consulting
Skill: Kafka Tester
Must Have Technical/Functional Skills:
Apache Kafka: Deep understanding of Kafka's architecture, components, and functionality.
SQL: Experience with SQL for data validation and debugging.
ETL: Experience with ETL processes and data warehousing concepts.
Test Automation: Experience in developing and maintaining automated tests for data pipelines.
Data Analysis: Ability to analyze data, identify issues, and propose solutions.
Communication: Strong communication and collaboration skills are essential for working with development teams.
Roles & Responsibilities: Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.
Data Validation: Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
Kafka Expertise: Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.
Scripting and Automation: Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
Issue Resolution: Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions.
Performance Testing: Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.
Agile/Scrum: Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
Data Warehousing: Familiarity with data warehousing concepts and cloud data platforms is often a plus.
SQL: Experience with SQL for data validation and debugging.
ETL: Experience with ETL processes and data warehousing concepts.
Test Automation: Experience in developing and maintaining automated tests for data pipelines.
Data Analysis: Ability to analyze data, identify issues, and propose solutions.
Communication: Strong communication and collaboration skills are essential for working with development teams.
Roles & Responsibilities: Data Pipeline Testing: Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.
Data Validation: Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
Kafka Expertise: Hands-on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.
Scripting and Automation: Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
Issue Resolution: Collaborating with developers to identify, analyze, and resolve data issues, performing root cause analysis, and proposing solutions.
Performance Testing: Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.
Agile/Scrum: Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
Data Warehousing: Familiarity with data warehousing concepts and cloud data platforms is often a plus.