hackajob
Overview
Join to apply for the
Senior Data Engineer
role at
hackajob . This position is with CGI US, located at the client site in Salt Lake City, UT. CGI is looking for a talented, driven, and experienced Senior Data Engineer (Databricks) with a passion for solving business problems. Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. Youll be part of a team of smart, dedicated people and make an impact with both internal and client stakeholders. Youll have opportunities to work with cutting edge technologies and cloud-native development. Responsibilities
Actively migrate use cases from on-premises Data Lake to Databricks on GCP Collaborate with Product Management and business partners to understand case requirements and reporting Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation) Document and showcase feature designs/workflows Participate in team meetings and discussions around product development Stay up to date on industry trends and design patterns Required Qualifications
5+ years of development experience with Spark (PySpark), Python and SQL Extensive experience building data pipelines Hands-on experience with Databricks Development Strong experience developing on Linux OS Experience with scheduling and orchestration (e.g. Databricks Workflows, Airflow, Prefect, Control-M) Solid understanding of distributed systems, data structures, design principles Comfortable presenting to teams via showcases/demos Agile Development Methodologies (e.g. SAFe, Kanban, Scrum) Experience with Databricks Unity Catalogue Experience in developing a metadata-driven framework on Databricks Bachelors degree in computer science, Computer Engineering or related field Desired Qualifications
3+ years experience with GIT 3+ years experience with CI/CD (e.g. Azure Pipelines) Experience with streaming technologies such as Kafka and Spark Experience building applications on Docker and Kubernetes Cloud experience (e.g. Azure, Google) Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: Software Development
#J-18808-Ljbffr
Join to apply for the
Senior Data Engineer
role at
hackajob . This position is with CGI US, located at the client site in Salt Lake City, UT. CGI is looking for a talented, driven, and experienced Senior Data Engineer (Databricks) with a passion for solving business problems. Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. Youll be part of a team of smart, dedicated people and make an impact with both internal and client stakeholders. Youll have opportunities to work with cutting edge technologies and cloud-native development. Responsibilities
Actively migrate use cases from on-premises Data Lake to Databricks on GCP Collaborate with Product Management and business partners to understand case requirements and reporting Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation) Document and showcase feature designs/workflows Participate in team meetings and discussions around product development Stay up to date on industry trends and design patterns Required Qualifications
5+ years of development experience with Spark (PySpark), Python and SQL Extensive experience building data pipelines Hands-on experience with Databricks Development Strong experience developing on Linux OS Experience with scheduling and orchestration (e.g. Databricks Workflows, Airflow, Prefect, Control-M) Solid understanding of distributed systems, data structures, design principles Comfortable presenting to teams via showcases/demos Agile Development Methodologies (e.g. SAFe, Kanban, Scrum) Experience with Databricks Unity Catalogue Experience in developing a metadata-driven framework on Databricks Bachelors degree in computer science, Computer Engineering or related field Desired Qualifications
3+ years experience with GIT 3+ years experience with CI/CD (e.g. Azure Pipelines) Experience with streaming technologies such as Kafka and Spark Experience building applications on Docker and Kubernetes Cloud experience (e.g. Azure, Google) Job Details
Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: Software Development
#J-18808-Ljbffr