Lead Data Engineer

Job Title: Lead Data Engineer Location: Remote (US-based) or Hybrid (New York) Employment Type: Full-time Compensation: Up to $220,000 + benefits (Remote) Up to $230,000 + benefits (Hybrid, NYC) About the Role We're hiring experienced Lead Data Engineers to support large-scale data transformation projects for enterprise clients in the financial services sector. You'll be embedded within a high-performing consulting team delivering mission-critical data platforms using Databricks and AWS . This is a hands-on engineering role focused on architecture, implementation, and optimization of robust data solutions at scale. Key Responsibilities Design, build, and deploy data pipelines and platforms using Databricks and cloud infrastructure (preferably AWS) Lead or contribute to end-to-end implementation of data solutions in enterprise environments Collaborate with architects, analysts, and client stakeholders to define technical requirements Optimize data systems for performance, scalability, and security Ensure data governance, quality, and compliance in all solutions Mentor junior engineers (Lead role) Required Skills & Experience 5+ years of experience in data engineering (7+ for Lead roles) Deep expertise with Databricks (Spark, Delta Lake, MLflow, Unity Catalog) Strong experience with cloud platforms , ideally AWS (S3, Glue, Lambda, etc.) Proven track record of delivering complex data solutions in financial services or other regulated industries Proficient in Python and SQL Experience with CI/CD for data pipelines and infrastructure-as-code tools (e.g., Terraform) Strong understanding of data modeling, lakehouse architectures, and data security best practices Nice to Have Experience with Azure or GCP in addition to AWS Knowledge of DevOps practices in data engineering Familiarity with regulatory frameworks (e.g., GDPR, SOC2, PCI-DSS) Why Join? Work on high-impact, high-visibility projects with enterprise financial clients Competitive compensation and full benefits package Flexible remote or hybrid working options Opportunity to work with cutting-edge tools and an experienced, collaborative team Interested? Apply now or reach out directly to learn more. Databricks #AWS #DataEngineering #Hiring #TechJobs #FinancialServices #BigData #CloudEngineering #RemoteJobs #NYCJobs #Lakehouse #Spark #ETL