Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Ampstek
Location: Boston, MA/Quincy, MA/Princeton, NJ(Onsite)_Local Preferred
Job Type: Contract
Job Summary
We are seeking a highly skilled Data Engineer with strong expertise in Databricks, Azure, Scala, and Hadoop to design, build, and optimize large-scale data pipelines and analytics solutions. The ideal candidate will have deep experience in big data technologies, cloud platforms, and distributed computing, and will work closely with data scientists, analysts, and business teams to deliver reliable and high-performing data solutions.
Key Responsibilities:
Design, develop, and maintain ETL/ELT pipelines in Databricks using Scala and Spark.
Build and optimize data processing workflows for structured and unstructured data.
Work with Hadoop ecosystem (HDFS, Hive, YARN, Oozie, Sqoop) for big data processing.
Design and maintain data lake and data warehouse architectures.
Use Delta Lake for ACID transactions and scalable data pipelines.
Collaborate with cross-functional teams to understand data requirements and deliver analytics-ready datasets.
Ensure data quality, governance, and security across all environments.
Optimize Spark jobs for performance and cost efficiency.
Participate in code reviews, CI/CD deployments, and Agile/Scrum processes.
Required Skills & Experience
5+ years of experience as a Data Engineer or Big Data Developer.
Strong hands-on experience with Databricks and Apache Spark.
Proficiency in Scala programming for big data processing.
Experience with Azure cloud services for data engineering.
Knowledge of Hadoop ecosystem tools and frameworks.
Strong SQL skills for data manipulation and transformation.
Familiarity with data formats (Parquet, ORC, Avro, JSON, CSV).
Understanding of data governance, quality, and security best practices.
Excellent problem-solving skills and ability to work in fast-paced environments.
Seniority level
Seniority level
Mid-Senior level
Employment type
Employment type
Contract
Job function
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Ampstek by 2x
Sign in to set job alerts for “Data Engineer” roles.
Boston, MA $100,906.00-$151,360.00 2 weeks ago
Boston, MA $170,000.00-$240,000.00 5 days ago
Engineer, Data Visualization and Business Intelligence
Boston, MA $160,000.00-$160,000.00 5 days ago
Ipswich, MA $95,295.00-$136,135.00 2 days ago
Boston, MA $120,000.00-$170,000.00 5 days ago
Boston, MA $225,590.00-$235,400.00 5 hours ago
Boston, MA $130,000.00-$180,000.00 6 months ago
Quincy, MA $93,840.00-$140,760.00 1 week ago
Boston, MA $115,000.00-$135,000.00 2 weeks ago
Bedford, MA $80,000.00-$100,000.00 1 week ago
Boston, MA $145,000.00-$204,000.00 2 weeks ago
Boston, MA $125,000.00-$178,000.00 4 months ago
Boston, MA $100,000.00-$200,000.00 4 months ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr