HCM Staffing and Consulting Group
Data Bricks Data Engineer
HCM Staffing and Consulting Group, Pleasanton, California, United States, 94566
Base pay range:
$49.00/hr - $49.00/hr This range is provided by HCM Staffing and Consulting Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview
We are seeking a skilled Data Engineer with hands-on Databricks experience to design, build, and optimize large-scale data pipelines and analytics solutions. You will work with cross-functional teams to enable scalable data processing using the Databricks Lakehouse Platform on Azure. Responsibilities
As a Data Bricks Data Engineer, you will analyze complex data sets to extract meaningful insights and support data-driven decision-making. Collect, process, and analyze large datasets to identify trends, patterns, and insights. Develop and implement machine learning models and algorithms to solve business problems. Create data visualizations and dashboards to communicate findings to stakeholders. Collaborate with project teams to understand data requirements and deliver relevant analytical solutions. Ensure data accuracy and integrity by performing data validation and quality checks. Qualifications
Bachelor’s or Master’s in Computer Science, Data Engineering, or a related field 5+ years of experience in data engineering or a similar role Strong hands-on experience with Databricks and Apache Spark (Python, Scala, or SQL) Proficiency with Delta Lake, Unity Catalog, and data lake architectures Experience with cloud platforms (Azure, AWS, or GCP), especially data services (e.g., S3, ADLS, BigQuery) Familiarity with CI/CD pipelines, version control (Git), and job orchestration tools (Airflow, DB Workflows) Strong understanding of data warehousing concepts, performance tuning, and big data processing Experience with MLflow, Feature Store, or other machine learning tools in Databricks (Preferred) Knowledge of data governance tools like Unity Catalog or Purview (Preferred) Experience integrating BI tools (Power BI, Tableau) with Databricks (Preferred) Seniorities and Employment
Seniority level: Associate Employment type: Contract Job function: Information Technology Industries: Technology, Information and Media Location: Foster City, CA
#J-18808-Ljbffr
$49.00/hr - $49.00/hr This range is provided by HCM Staffing and Consulting Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Overview
We are seeking a skilled Data Engineer with hands-on Databricks experience to design, build, and optimize large-scale data pipelines and analytics solutions. You will work with cross-functional teams to enable scalable data processing using the Databricks Lakehouse Platform on Azure. Responsibilities
As a Data Bricks Data Engineer, you will analyze complex data sets to extract meaningful insights and support data-driven decision-making. Collect, process, and analyze large datasets to identify trends, patterns, and insights. Develop and implement machine learning models and algorithms to solve business problems. Create data visualizations and dashboards to communicate findings to stakeholders. Collaborate with project teams to understand data requirements and deliver relevant analytical solutions. Ensure data accuracy and integrity by performing data validation and quality checks. Qualifications
Bachelor’s or Master’s in Computer Science, Data Engineering, or a related field 5+ years of experience in data engineering or a similar role Strong hands-on experience with Databricks and Apache Spark (Python, Scala, or SQL) Proficiency with Delta Lake, Unity Catalog, and data lake architectures Experience with cloud platforms (Azure, AWS, or GCP), especially data services (e.g., S3, ADLS, BigQuery) Familiarity with CI/CD pipelines, version control (Git), and job orchestration tools (Airflow, DB Workflows) Strong understanding of data warehousing concepts, performance tuning, and big data processing Experience with MLflow, Feature Store, or other machine learning tools in Databricks (Preferred) Knowledge of data governance tools like Unity Catalog or Purview (Preferred) Experience integrating BI tools (Power BI, Tableau) with Databricks (Preferred) Seniorities and Employment
Seniority level: Associate Employment type: Contract Job function: Information Technology Industries: Technology, Information and Media Location: Foster City, CA
#J-18808-Ljbffr