ECS
Overview
ECS is seeking a Sr. Databricks Consultant to work remotely. This position is contingent upon contract award. The role involves consulting with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. You will leverage Delta Lake, MLflow, and Databricks Machine Learning to maximize performance, scalability, and value from clients\' data platforms. The role supports ECS\' Professional Services and Managed Cybersecurity Services programs, focusing on Databricks solutions and data pipeline optimization, scalable model training, and advanced analytics. If you are passionate about applying data science techniques within the Databricks ecosystem to solve real-world challenges, we encourage you to apply.
Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
Optimize workflows and clusters for performance and cost efficiency.
Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
Implement data governance, security, and compliance standards.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
Troubleshoot issues and drive continuous improvement in data infrastructure.
Required Skills
Proven experience working with Databricks in production environments.
Strong proficiency in Python and/or SQL for data engineering.
Experience with Apache Spark for distributed data processing.
Knowledge of data lakehouse architecture and best practices.
Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
Hands-on experience building and managing ETL/ELT pipelines.
Strong understanding of data modeling, data quality, and performance tuning.
Familiarity with CI/CD pipelines and version control (Git).
Able and willing to obtain a US Security Clearance.
Ability to travel, as needed, to customer sites.
Must be a US Citizen per contract.
Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.
Desired Skills
Master\'s degree or PhD in Computer Science, Data Science, or a related field
Experience with machine learning pipelines in Databricks (MLflow).
Knowledge of Delta Lake and Unity Catalog for governance.
Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
Exposure to data visualization tools (Tableau, Power BI, or Looker).
Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
Strong understanding of DevOps/MLOps practices.
Prior consulting or customer-facing experience
Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments.
Equal Opportunity ECS is an equal opportunity employer and does not discriminate or allow discrimination on the basis of any characteristic protected by law. All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, or local jurisdiction law.
ECS is a leading mid-sized provider of technology services to the United States Federal Government. We are focused on people, values and purpose. Every day, our 3500+ employees focus on providing their technical talent to support the Federal Agencies and Departments of the US Government to serve, protect and defend the American People.
#J-18808-Ljbffr
ECS is seeking a Sr. Databricks Consultant to work remotely. This position is contingent upon contract award. The role involves consulting with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. You will leverage Delta Lake, MLflow, and Databricks Machine Learning to maximize performance, scalability, and value from clients\' data platforms. The role supports ECS\' Professional Services and Managed Cybersecurity Services programs, focusing on Databricks solutions and data pipeline optimization, scalable model training, and advanced analytics. If you are passionate about applying data science techniques within the Databricks ecosystem to solve real-world challenges, we encourage you to apply.
Responsibilities
Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
Optimize workflows and clusters for performance and cost efficiency.
Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
Implement data governance, security, and compliance standards.
Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
Troubleshoot issues and drive continuous improvement in data infrastructure.
Required Skills
Proven experience working with Databricks in production environments.
Strong proficiency in Python and/or SQL for data engineering.
Experience with Apache Spark for distributed data processing.
Knowledge of data lakehouse architecture and best practices.
Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
Hands-on experience building and managing ETL/ELT pipelines.
Strong understanding of data modeling, data quality, and performance tuning.
Familiarity with CI/CD pipelines and version control (Git).
Able and willing to obtain a US Security Clearance.
Ability to travel, as needed, to customer sites.
Must be a US Citizen per contract.
Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.
Desired Skills
Master\'s degree or PhD in Computer Science, Data Science, or a related field
Experience with machine learning pipelines in Databricks (MLflow).
Knowledge of Delta Lake and Unity Catalog for governance.
Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
Exposure to data visualization tools (Tableau, Power BI, or Looker).
Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
Strong understanding of DevOps/MLOps practices.
Prior consulting or customer-facing experience
Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments.
Equal Opportunity ECS is an equal opportunity employer and does not discriminate or allow discrimination on the basis of any characteristic protected by law. All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, or local jurisdiction law.
ECS is a leading mid-sized provider of technology services to the United States Federal Government. We are focused on people, values and purpose. Every day, our 3500+ employees focus on providing their technical talent to support the Federal Agencies and Departments of the US Government to serve, protect and defend the American People.
#J-18808-Ljbffr