Jobs via Dice
(Data Engineer) Spark/Kafka
Jobs via Dice - Houston, Texas, United States, 77246
Work at Jobs via Dice
Overview
- View job
Overview
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Nityo Infotech Corporation, is seeking a Data Engineer (Spark/Kafka). Apply via Dice today!
Job Details:
Location:
Houston, TX Type:
Full Time Job Description:
Client is seeking a Spark/Kafka Lead Developer to enable digital transformation for our clients in a global delivery model. You will research technologies, recommend solutions, support best practices, and collaborate across the Software Development Life Cycle. We foster a learning culture that encourages partnership, excellence, diversity, and collaboration. Required Qualifications:
Bachelor's degree or foreign equivalent from an accredited institution, or three years of progressive experience in the field in lieu of each year of education. Minimum 7 years of IT experience. Experience with Hadoop ecosystem & Apache Spark. Experience with Kafka streaming. Strong skills in SQL, Unix shell scripting. Preferred Qualifications:
Proficiency in Scala, Java, or Python. At least 4 years of experience with Apache Spark modules such as Spark Core, Spark SQL, Spark Streaming, and Spark MLlib. Experience leading development and optimization of batch and real-time data pipelines. Ability to architect and deploy data solutions using Spark, Kafka, and Snowflake. Hands-on experience with Apache Kafka components like topics, partitions, producers, consumers, and stream processing. Understanding of distributed computing, data partitioning, fault tolerance, and parallel processing. Experience with cluster management tools like Apache Mesos or YARN is desirable. Knowledge of data integration, quality, and architecture, including relational and dimensional modeling. Familiarity with Agile development frameworks. Strong communication and analytical skills. Ability to work in diverse, multi-stakeholder environments and in a global delivery setting. Additional Information:
This job posting is active. No indication that it is expired or no longer accepting applications.
#J-18808-Ljbffr
Location:
Houston, TX Type:
Full Time Job Description:
Client is seeking a Spark/Kafka Lead Developer to enable digital transformation for our clients in a global delivery model. You will research technologies, recommend solutions, support best practices, and collaborate across the Software Development Life Cycle. We foster a learning culture that encourages partnership, excellence, diversity, and collaboration. Required Qualifications:
Bachelor's degree or foreign equivalent from an accredited institution, or three years of progressive experience in the field in lieu of each year of education. Minimum 7 years of IT experience. Experience with Hadoop ecosystem & Apache Spark. Experience with Kafka streaming. Strong skills in SQL, Unix shell scripting. Preferred Qualifications:
Proficiency in Scala, Java, or Python. At least 4 years of experience with Apache Spark modules such as Spark Core, Spark SQL, Spark Streaming, and Spark MLlib. Experience leading development and optimization of batch and real-time data pipelines. Ability to architect and deploy data solutions using Spark, Kafka, and Snowflake. Hands-on experience with Apache Kafka components like topics, partitions, producers, consumers, and stream processing. Understanding of distributed computing, data partitioning, fault tolerance, and parallel processing. Experience with cluster management tools like Apache Mesos or YARN is desirable. Knowledge of data integration, quality, and architecture, including relational and dimensional modeling. Familiarity with Agile development frameworks. Strong communication and analytical skills. Ability to work in diverse, multi-stakeholder environments and in a global delivery setting. Additional Information:
This job posting is active. No indication that it is expired or no longer accepting applications.
#J-18808-Ljbffr