Jobs via Dice
Senior Platform Engineer (Databricks)
Jobs via Dice, Los Angeles, California, United States, 90079
Overview
Senior Platform Engineer (Databricks) – Direct-Hire/FTE – Remote (US) Location: Remote (US) Compensation: $140-160K Annual Base Salary Work Requirements: Holders or Authorized to Work in the U.S. The Role
This is a hands-on Senior Platform Engineer (Databricks) role that will require strong Python/PySpark coding skills. This is NOT a ETL/ELT development role. Responsibilities
Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team Design and build self-servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way Design and build platform capabilities to support onboarding and operation effectiveness Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform Ensure data quality and integrity across all data systems Ensure data security and compliance with relevant regulations Implement best practices for data management and governance Develop and maintain documentation for data systems and processes Monitor and troubleshoot data platform issues Participate in on-call rotations/Pagerduty for data platform support Technical Skills/Competencies
Good understanding of Data Lakes, Data Warehouses Software development, coding expertise in the Data engineering field using Python/PySpark Hands-on experience with version control systems (Git) and CI/CD workflows Design and develop data ingestion services that are highly performant, reliable and scalable Proficiency in ANSI SQL and Spark SQL Workflow automation/orchestration using Airflow or equivalent tools Hands-on experience with Databricks, Hadoop and related stacks Experience with at least one cloud service (AWS, GCP, or Azure; AWS preferred) Experience with streaming (Kafka) and batch data sources Experience with diverse data sources and formats (xml, json, yaml, parquet, avro, delta) Visualization experience is a plus Understanding of time zones, geo considerations, and data formats across storage systems Agile development methodologies using Jira and Confluence Ability to collaborate with cross-functional teams and provide technical guidance Staying up-to-date with the latest data engineering technologies and trends About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we align industry and technical expertise with clients\' business objectives and cultural needs. Learn more about us at inspyrsolutions.com. INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. Seniority level: Mid-Senior level Employment type: Full-time Job function: Engineering and Information Technology Industries: Software Development
#J-18808-Ljbffr
Senior Platform Engineer (Databricks) – Direct-Hire/FTE – Remote (US) Location: Remote (US) Compensation: $140-160K Annual Base Salary Work Requirements: Holders or Authorized to Work in the U.S. The Role
This is a hands-on Senior Platform Engineer (Databricks) role that will require strong Python/PySpark coding skills. This is NOT a ETL/ELT development role. Responsibilities
Contribute to the enhancements and continuous improvement of performance and reliability of the existing Data Platform Services to meet the requirements from Data Engineering/Product team Design and build self-servicing onboarding and automation capabilities in Core Data Platform services in a scalable, reliable and secure way Design and build platform capabilities to support onboarding and operation effectiveness Design and develop scalable data platform and integration solutions for various data sources leveraging Databricks Unified Platform Ensure data quality and integrity across all data systems Ensure data security and compliance with relevant regulations Implement best practices for data management and governance Develop and maintain documentation for data systems and processes Monitor and troubleshoot data platform issues Participate in on-call rotations/Pagerduty for data platform support Technical Skills/Competencies
Good understanding of Data Lakes, Data Warehouses Software development, coding expertise in the Data engineering field using Python/PySpark Hands-on experience with version control systems (Git) and CI/CD workflows Design and develop data ingestion services that are highly performant, reliable and scalable Proficiency in ANSI SQL and Spark SQL Workflow automation/orchestration using Airflow or equivalent tools Hands-on experience with Databricks, Hadoop and related stacks Experience with at least one cloud service (AWS, GCP, or Azure; AWS preferred) Experience with streaming (Kafka) and batch data sources Experience with diverse data sources and formats (xml, json, yaml, parquet, avro, delta) Visualization experience is a plus Understanding of time zones, geo considerations, and data formats across storage systems Agile development methodologies using Jira and Confluence Ability to collaborate with cross-functional teams and provide technical guidance Staying up-to-date with the latest data engineering technologies and trends About INSPYR Solutions
Technology is our focus and quality is our commitment. As a national expert in delivering flexible technology and talent solutions, we align industry and technical expertise with clients\' business objectives and cultural needs. Learn more about us at inspyrsolutions.com. INSPYR Solutions provides Equal Employment Opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, or genetics. In addition to federal law requirements, INSPYR Solutions complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. Seniority level: Mid-Senior level Employment type: Full-time Job function: Engineering and Information Technology Industries: Software Development
#J-18808-Ljbffr