Coherent Solutions
We are looking for an experienced Data Engineer with deep expertise in Databricks to join our advanced analytics and data engineering team. The ideal candidate will play a key role in designing, building, and optimizing large-scale data solutions on the Databricks platform, supporting business intelligence, advanced analytics, and machine learning initiatives. You will collaborate with cross-functional teams to deliver robust, scalable, and high-performance data pipelines and architectures.
Technologies
Python/Scala SQL ETL concepts Distributed data processing Data warehousing What You'll Do
Lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks (Spark, Delta Lake, MLflow); Architect and implement data lakehouse solutions, ensuring data quality, governance, and security; Optimize data workflows for performance and cost efficiency on Databricks and cloud platforms (Azure, AWS, or GCP); Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights; Mentor and guide junior engineers, promoting best practices in data engineering and Databricks usage; Develop and maintain documentation, data models, and technical standards; Monitor, troubleshoot, and resolve issues in production data pipelines and environments; Stay current with emerging trends and technologies in data engineering and Databricks ecosystem; Job Requirements
Bachelors or Masters degree in Computer Science, Engineering, Mathematics, or a related field; 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Databricks (including Spark, Delta Lake, and MLflow); Strong proficiency in Python and/or Scala for data processing; Deep understanding of distributed data processing, data warehousing, and ETL concepts; Experience with cloud data platforms (Azure Data Lake, AWS S3, or Google Cloud Storage); Solid knowledge of SQL and experience with large-scale relational and NoSQL databases; Familiarity with CI/CD, DevOps, and infrastructure-as-code practices for data engineering; Experience with data governance, security, and compliance in cloud environments; Excellent problem-solving, communication, and leadership skills; English: Upper Intermediate level or higher; What Do We Offer
The global benefits package includes: Technical and non-technical training for professional and personal growth; Internal conferences and meetups to learn from industry experts; Support and mentorship from an experienced employee to help you professional grow and development; Internal startup incubator; Health insurance; Sports activities to promote a healthy lifestyle; Flexible work options, including remote and hybrid opportunities; Referral program for bringing in new talent; Work anniversary program and additional vacation days. We will be glad to see you!
First Name Last Name Email Referral Add the name of our employee (e.g. John Smith) Comments Attach file Attach file Formats (3 MB): doc, docx, pdf, txt, rtf I have acknowledged and agree that Coherent Solutions will process my submitted personal data pursuant toPrivacy Policy for Job Applicants and understand that due to international presence of Coherent Solutions my personal data may be transferred to third countries. I also give consent to Coherent Solutions to process my personal data for 3 (three) years for the purpose to notify me about future job openings. I am informed that I can withdraw my consent anytime by submitting a request toprivacy@coherentsolutions.com. In such case my personal data will be deleted from a candidates database. #J-18808-Ljbffr
Python/Scala SQL ETL concepts Distributed data processing Data warehousing What You'll Do
Lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks (Spark, Delta Lake, MLflow); Architect and implement data lakehouse solutions, ensuring data quality, governance, and security; Optimize data workflows for performance and cost efficiency on Databricks and cloud platforms (Azure, AWS, or GCP); Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights; Mentor and guide junior engineers, promoting best practices in data engineering and Databricks usage; Develop and maintain documentation, data models, and technical standards; Monitor, troubleshoot, and resolve issues in production data pipelines and environments; Stay current with emerging trends and technologies in data engineering and Databricks ecosystem; Job Requirements
Bachelors or Masters degree in Computer Science, Engineering, Mathematics, or a related field; 5+ years of experience in data engineering, with at least 2 years of hands-on experience with Databricks (including Spark, Delta Lake, and MLflow); Strong proficiency in Python and/or Scala for data processing; Deep understanding of distributed data processing, data warehousing, and ETL concepts; Experience with cloud data platforms (Azure Data Lake, AWS S3, or Google Cloud Storage); Solid knowledge of SQL and experience with large-scale relational and NoSQL databases; Familiarity with CI/CD, DevOps, and infrastructure-as-code practices for data engineering; Experience with data governance, security, and compliance in cloud environments; Excellent problem-solving, communication, and leadership skills; English: Upper Intermediate level or higher; What Do We Offer
The global benefits package includes: Technical and non-technical training for professional and personal growth; Internal conferences and meetups to learn from industry experts; Support and mentorship from an experienced employee to help you professional grow and development; Internal startup incubator; Health insurance; Sports activities to promote a healthy lifestyle; Flexible work options, including remote and hybrid opportunities; Referral program for bringing in new talent; Work anniversary program and additional vacation days. We will be glad to see you!
First Name Last Name Email Referral Add the name of our employee (e.g. John Smith) Comments Attach file Attach file Formats (3 MB): doc, docx, pdf, txt, rtf I have acknowledged and agree that Coherent Solutions will process my submitted personal data pursuant toPrivacy Policy for Job Applicants and understand that due to international presence of Coherent Solutions my personal data may be transferred to third countries. I also give consent to Coherent Solutions to process my personal data for 3 (three) years for the purpose to notify me about future job openings. I am informed that I can withdraw my consent anytime by submitting a request toprivacy@coherentsolutions.com. In such case my personal data will be deleted from a candidates database. #J-18808-Ljbffr