USM
Job Description: Sr Big Data Engineer at Beaverton, OR
We have an immediate opportunity for a Sr Big Data Engineer with our direct client in Beaverton, OR. The ideal candidate will have a strong background in data engineering and experience working with big data technologies. Location:
Beaverton, OR Duration:
Long Term Job Type:
Contract Core Responsibilities
Expert data engineers will work with product teams across the client to help automate and integrate various data domains with a wide variety of data profiles into the client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes. Required Skills/Experience
5+ years of professional development experience in Python (preferred) or Scala/Java; familiarity with both is ideal 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized) 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc) Direct task development and/or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc. Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds Desired Skills
A demonstrably strong understanding of security and credential management between application / platform components A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization Direct experience with Netflix Genie Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management) Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub) Keys to Success
Demonstrate accountability and integrity Be willing to learn and adapt every day We are an equal opportunity employer and welcome applications from diverse candidates. All your information will be kept confidential according to EEO guidelines.
#J-18808-Ljbffr
We have an immediate opportunity for a Sr Big Data Engineer with our direct client in Beaverton, OR. The ideal candidate will have a strong background in data engineering and experience working with big data technologies. Location:
Beaverton, OR Duration:
Long Term Job Type:
Contract Core Responsibilities
Expert data engineers will work with product teams across the client to help automate and integrate various data domains with a wide variety of data profiles into the client's next-gen data and analytics platform. This is an opportunity to work across multiple subject areas and source platforms to ingest, organize, and prepare data through cloud-native processes. Required Skills/Experience
5+ years of professional development experience in Python (preferred) or Scala/Java; familiarity with both is ideal 5+ years of data-centric development with a focus on efficient data access and manipulation at multiple scales 3+ years of experience with the HDFS ecosystem of tools (any distro, Spark experience prioritized) 3+ years of significant experience developing within the broader AWS ecosystem of platforms and services 3+ years of experience optimizing data access and analysis in non-HDFS data platforms (Traditional RDMS's, NoSQL / KV stores, etc) Direct task development and/or configuration experience with a remote workflow orchestration tool – Airflow (preferred), Amazon Data Pipeline, Luigi, Oozie, etc. Intelligence, strong problem-solving ability, and the ability to effectively communicate to partners with a broad spectrum of experiential backgrounds Desired Skills
A demonstrably strong understanding of security and credential management between application / platform components A demonstrably strong understanding of core considerations when working with data at scale, in both file-based and database contexts, including SQL optimization Direct experience with Netflix Genie Prior experience with the operational backbone of a CI/CD environment (pipeline orchestration + configuration management) Clean coding practices, passion for development, being a generally good team player, etc, etc (and experience with GitHub) Keys to Success
Demonstrate accountability and integrity Be willing to learn and adapt every day We are an equal opportunity employer and welcome applications from diverse candidates. All your information will be kept confidential according to EEO guidelines.
#J-18808-Ljbffr