Proven Recruiting
Senior Data Engineer - ML & Performance Optimization
Proven Recruiting, New York, New York, us, 10261
Senior Data Engineer - ML & Performance Optimization
Senior Data Engineer (Hybrid – NYC or Washington, D.C.)
Who You Are
Experienced data engineer (7–10+ years) with deep expertise in Databricks (PySpark, Delta Lake, SQL) and AWS (S3, Glue, EMR, Lambda, Kinesis)
Proficient in Python (preferred), Scala, or Java with strong focus on performance optimization and scalable systems
Passionate about building and maintaining large‑scale data platforms that power analytics and machine learning
Collaborative and detail‑oriented, able to partner closely with data scientists and engineers to productionize ML workflows
What You’ll Do
Design, build, and optimize data pipelines and feature store components using Databricks and AWS
Develop and maintain a centralized Feature Store to support machine learning model training and inference
Collaborate with data scientists and ML engineers to productionize models and ensure scalability and efficiency
Implement CI/CD workflows, enforce data quality standards, and improve performance across the platform
Stay up to date on Databricks, Spark, and AWS ecosystem advancements to continuously improve architecture and workflows
Compensation
Compensation is determined by several factors which may include skillset, experience level, and geographic location. The expected range for this role is $74.00 to $83.00 per hour. Please note this range is an estimate and actual pay may vary based on qualifications and experience. This position is not eligible C2C.
What next?
If interested, send your resume directly to
klopez@provenrecruiting.com
Diversity Note:
We actively support and promote people of various backgrounds from race, religion, gender to geographical area, university, lifestyle, and personality type. Proven Recruiting is minority‑owned, majority women and is a strong advocate for diversity and inclusion in the community.
Apply Today! #IND3
#J-18808-Ljbffr
Who You Are
Experienced data engineer (7–10+ years) with deep expertise in Databricks (PySpark, Delta Lake, SQL) and AWS (S3, Glue, EMR, Lambda, Kinesis)
Proficient in Python (preferred), Scala, or Java with strong focus on performance optimization and scalable systems
Passionate about building and maintaining large‑scale data platforms that power analytics and machine learning
Collaborative and detail‑oriented, able to partner closely with data scientists and engineers to productionize ML workflows
What You’ll Do
Design, build, and optimize data pipelines and feature store components using Databricks and AWS
Develop and maintain a centralized Feature Store to support machine learning model training and inference
Collaborate with data scientists and ML engineers to productionize models and ensure scalability and efficiency
Implement CI/CD workflows, enforce data quality standards, and improve performance across the platform
Stay up to date on Databricks, Spark, and AWS ecosystem advancements to continuously improve architecture and workflows
Compensation
Compensation is determined by several factors which may include skillset, experience level, and geographic location. The expected range for this role is $74.00 to $83.00 per hour. Please note this range is an estimate and actual pay may vary based on qualifications and experience. This position is not eligible C2C.
What next?
If interested, send your resume directly to
klopez@provenrecruiting.com
Diversity Note:
We actively support and promote people of various backgrounds from race, religion, gender to geographical area, university, lifestyle, and personality type. Proven Recruiting is minority‑owned, majority women and is a strong advocate for diversity and inclusion in the community.
Apply Today! #IND3
#J-18808-Ljbffr