Big Data Developer

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from IPolarity Job Title: Big Data Hadoop Developer with Spark (10+ Years Min) Location: New York City, NY ( Onsite) Duration: Long-term Contract About the Role We are seeking a highly skilled Big Data Hadoop Developer with expertise in Apache Spark to join its technology team in New York. The candidate will be responsible for designing, building, and optimizing large-scale data processing systems to support critical business applications and analytics. Responsibilities Design and develop data ingestion, processing, and transformation pipelines using Hadoop ecosystem tools (HDFS, Hive, HBase, Oozie, Sqoop, Flume). Build and optimize distributed data processing applications using Apache Spark (Core, SQL, Streaming). Work with structured and unstructured data to develop scalable and high-performance solutions. Collaborate with data architects, business analysts, and application teams to understand requirements and deliver robust solutions. Implement best practices for performance tuning, data security, and data governance. Troubleshoot and resolve issues related to Hadoop clusters, Spark jobs, and data pipelines. Participate in Agile/Scrum development cycles, contributing to sprint planning, code reviews, and technical discussions. Required Skills 58 years of experience in Big Data / Hadoop ecosystem. Strong expertise in Apache Spark (Core, SQL, Streaming) for batch and real-time processing. Hands-on experience with HDFS, Hive, HBase, Sqoop, Oozie, Flume, and YARN. Solid programming skills in Java / Scala / Python. Knowledge of CI/CD pipelines, Git, and DevOps practices preferred. Seniority level

Seniority level

Mid-Senior level Employment type

Employment type

Contract Job function

Job function

Information Technology Industries

Staffing and Recruiting Referrals increase your chances of interviewing at IPolarity by 2x Get notified about new Big Data Developer jobs in

New York, NY . New York, NY $180,000.00-$230,000.00 1 month ago New York, NY $120,000.00-$150,000.00 1 month ago New York, NY $80,000.00-$160,000.00 2 months ago Weehawken, NJ $75,000.00-$130,000.00 3 weeks ago New York, NY $101,000.00-$135,000.00 1 week ago New York, NY $90,000.00-$130,000.00 6 months ago New York, NY $160,000.00-$250,000.00 3 days ago New York, NY $80,000.00-$100,000.00 2 months ago New York, NY $130,000.00-$200,000.00 9 months ago New York, NY $170,000.00-$240,000.00 1 week ago New York, NY $123,000.00-$160,000.00 2 weeks ago Manhattan, NY $140,000.00-$160,000.00 3 weeks ago New York, NY $120,000.00-$250,000.00 2 weeks ago New York, NY $133,920.00-$193,750.00 5 days ago New York, NY $112,597.33-$152,810.66 3 weeks ago Data Engineer with Python / SQL - Onsite (Fulltime)

New York, NY $120,000.00-$180,000.00 3 weeks ago New York, NY $155,250.00-$174,273.00 1 month ago New York City Metropolitan Area $90,000.00-$130,000.00 1 week ago New York, NY $79,310.00-$173,040.00 1 month ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr