Avance Consulting
1 day ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from Avance Consulting
The Databricks Architect - Lead
is a critical role within our Data and Analytics practice, tasked with designing, implementing, and optimizing advanced data architectures using Databricks. This role involves close collaboration with data scientists, analysts, and business stakeholders to deliver scalable, secure, and efficient data solutions that align with organizational goals. The ideal candidate will bring deep expertise in Databricks, Apache Spark, and cloud platforms, with a proven ability to lead complex data architecture initiatives. In this role, you will architect data lakes, data warehouses, and real-time processing systems, optimize Databricks clusters for performance and cost, and develop robust ETL/ELT pipelines. You will also ensure data governance and compliance, integrate Databricks with cloud ecosystems, and stay ahead of industry trends to drive innovation. Reporting to the Director of Data Architecture, you will play a key role in shaping our data strategy and delivering business value. About You (Desired Profile) 10-15 years of experience in data architecture, with a strong focus on Databricks and Apache Spark. Proven expertise in designing and implementing data lakes, data warehouses, and real-time processing systems. Hands-on experience with Databricks cluster management, optimization, and performance tuning. Pharmaceutical data knowledge is required and mandatory Strong proficiency in developing ETL/ELT pipelines using Apache Spark. In-depth knowledge of data governance, security, and compliance in cloud environments. Exceptional communication and collaboration skills, with the ability to engage effectively with cross-functional teams. Extensive experience with cloud platforms (AWS, Azure, or GCP) and integrating Databricks with cloud services. Proficiency in programming languages such as Python, Scala, Java, SQL, or R. Bachelor’s degree in computer science, Data Science, or a related field; an advanced degree (e.g., Master’s) is a plus. Certifications in Databricks, AWS technologies REQUIRED. Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: IT Services and IT Consulting and Information Services We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
is a critical role within our Data and Analytics practice, tasked with designing, implementing, and optimizing advanced data architectures using Databricks. This role involves close collaboration with data scientists, analysts, and business stakeholders to deliver scalable, secure, and efficient data solutions that align with organizational goals. The ideal candidate will bring deep expertise in Databricks, Apache Spark, and cloud platforms, with a proven ability to lead complex data architecture initiatives. In this role, you will architect data lakes, data warehouses, and real-time processing systems, optimize Databricks clusters for performance and cost, and develop robust ETL/ELT pipelines. You will also ensure data governance and compliance, integrate Databricks with cloud ecosystems, and stay ahead of industry trends to drive innovation. Reporting to the Director of Data Architecture, you will play a key role in shaping our data strategy and delivering business value. About You (Desired Profile) 10-15 years of experience in data architecture, with a strong focus on Databricks and Apache Spark. Proven expertise in designing and implementing data lakes, data warehouses, and real-time processing systems. Hands-on experience with Databricks cluster management, optimization, and performance tuning. Pharmaceutical data knowledge is required and mandatory Strong proficiency in developing ETL/ELT pipelines using Apache Spark. In-depth knowledge of data governance, security, and compliance in cloud environments. Exceptional communication and collaboration skills, with the ability to engage effectively with cross-functional teams. Extensive experience with cloud platforms (AWS, Azure, or GCP) and integrating Databricks with cloud services. Proficiency in programming languages such as Python, Scala, Java, SQL, or R. Bachelor’s degree in computer science, Data Science, or a related field; an advanced degree (e.g., Master’s) is a plus. Certifications in Databricks, AWS technologies REQUIRED. Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: IT Services and IT Consulting and Information Services We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr