Hadoop Data Engineer

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from Ampstek Location: Boston, MA/Quincy, MA/Princeton, NJ(Onsite)_Local Preferred Job Type: Contract Job Summary We are seeking a highly skilled Data Engineer with strong expertise in Databricks, Azure, Scala, and Hadoop to design, build, and optimize large-scale data pipelines and analytics solutions. The ideal candidate will have deep experience in big data technologies, cloud platforms, and distributed computing, and will work closely with data scientists, analysts, and business teams to deliver reliable and high-performing data solutions. Key Responsibilities: Design, develop, and maintain ETL/ELT pipelines in Databricks using Scala and Spark. Build and optimize data processing workflows for structured and unstructured data. Work with Hadoop ecosystem (HDFS, Hive, YARN, Oozie, Sqoop) for big data processing. Design and maintain data lake and data warehouse architectures. Use Delta Lake for ACID transactions and scalable data pipelines. Collaborate with cross-functional teams to understand data requirements and deliver analytics-ready datasets. Ensure data quality, governance, and security across all environments. Optimize Spark jobs for performance and cost efficiency. Participate in code reviews, CI/CD deployments, and Agile/Scrum processes. Required Skills & Experience 5+ years of experience as a Data Engineer or Big Data Developer. Strong hands-on experience with Databricks and Apache Spark. Proficiency in Scala programming for big data processing. Experience with Azure cloud services for data engineering. Knowledge of Hadoop ecosystem tools and frameworks. Strong SQL skills for data manipulation and transformation. Familiarity with data formats (Parquet, ORC, Avro, JSON, CSV). Understanding of data governance, quality, and security best practices. Excellent problem-solving skills and ability to work in fast-paced environments. Seniority level

Seniority level Mid-Senior level Employment type

Employment type Contract Job function

Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Ampstek by 2x Sign in to set job alerts for “Data Engineer” roles.

Boston, MA $100,906.00-$151,360.00 2 weeks ago Boston, MA $170,000.00-$240,000.00 5 days ago Engineer, Data Visualization and Business Intelligence

Boston, MA $160,000.00-$160,000.00 5 days ago Ipswich, MA $95,295.00-$136,135.00 2 days ago Boston, MA $120,000.00-$170,000.00 5 days ago Boston, MA $225,590.00-$235,400.00 5 hours ago Boston, MA $130,000.00-$180,000.00 6 months ago Quincy, MA $93,840.00-$140,760.00 1 week ago Boston, MA $115,000.00-$135,000.00 2 weeks ago Bedford, MA $80,000.00-$100,000.00 1 week ago Boston, MA $145,000.00-$204,000.00 2 weeks ago Boston, MA $125,000.00-$178,000.00 4 months ago Boston, MA $100,000.00-$200,000.00 4 months ago We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr