FocusKPI Inc.
FocusKPI is seeking a Data Pipeline Engineer to join one of our clients, a high-tech SaaS company.
The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group, which focuses on rapidly developing AI-driven, cloud-based end-to-end mobile applications and services.
Data Pipeline Engineer IV involves building & managing pipelines and ETLs, requiring expertise with Spark, Iceberg, and Python coding as the main requirements.
Work Location: Mountain View, CA (Hybrid role, 4 days/week onsite mandatorily)
Duration: 12-month contract with potential to convert depending on the candidate's performance
Pay Range: $85/hr to $95/hr
No C2C resumes are considered
Responsibilities:
Implement, maintain, and evolve the big data platform and infrastructure
Responsible for designing, implementing, and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence systems
Perform extensive research and analysis to make optimal architecture and design decisions
Write large amounts of code, perform code reviews, write unit tests, and documentation
Interface with other groups, including Product Management, QA, and Operations · Create quick proof-of-concept prototypes
Work in a scrum team with ML & Cloud Engineers
Qualifications:
Minimum of 4+ years of hands-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaAnA
Master's in Computer Science or equivalent experience is preferred
Expertise with Spark and Iceberg are mandatory to have
Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
Programming Language: Python coding expertise is required
Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
Hands-on experience in building REST API’s
Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
Desire to learn fast and pick up the latest and greatest technologies
Preferred qualifications:
Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
Machine Learning: PyTorch, TensorFlow, Spark ML
REST API: Flask, FastAPI, or Django
Data Quality tools such as Monte Carlo, Great Expectations, or Databand
Experience with teams using MLflow
No C2C resumes are considered
Thank you!
FocusKPI Hiring Team
Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.
NOTICE: Please be aware of fraudulent emails regarding job postings, job offers and fake checks. FocusKPI's recruiting team will strictly reach out via @focuskpi.com email domain. If you have received fraudulent emails now or in the past, please report it to https://reportfraud.ftc.gov/ . The domain @focuskpijobs.com is fraudulent and not related to FocusKPI. Please do not not reply or communicate to anyone with @focuskpijobs.com.
Powered by JazzHR
The team is seeking world-class server software engineers with experience in Big Data Infrastructure and Data warehousing to join their technology innovation group, which focuses on rapidly developing AI-driven, cloud-based end-to-end mobile applications and services.
Data Pipeline Engineer IV involves building & managing pipelines and ETLs, requiring expertise with Spark, Iceberg, and Python coding as the main requirements.
Work Location: Mountain View, CA (Hybrid role, 4 days/week onsite mandatorily)
Duration: 12-month contract with potential to convert depending on the candidate's performance
Pay Range: $85/hr to $95/hr
No C2C resumes are considered
Responsibilities:
Implement, maintain, and evolve the big data platform and infrastructure
Responsible for designing, implementing, and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence systems
Perform extensive research and analysis to make optimal architecture and design decisions
Write large amounts of code, perform code reviews, write unit tests, and documentation
Interface with other groups, including Product Management, QA, and Operations · Create quick proof-of-concept prototypes
Work in a scrum team with ML & Cloud Engineers
Qualifications:
Minimum of 4+ years of hands-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & KafkaAnA
Master's in Computer Science or equivalent experience is preferred
Expertise with Spark and Iceberg are mandatory to have
Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis
Programming Language: Python coding expertise is required
Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking
Hands-on experience in building REST API’s
Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering
Desire to learn fast and pick up the latest and greatest technologies
Preferred qualifications:
Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN
Machine Learning: PyTorch, TensorFlow, Spark ML
REST API: Flask, FastAPI, or Django
Data Quality tools such as Monte Carlo, Great Expectations, or Databand
Experience with teams using MLflow
No C2C resumes are considered
Thank you!
FocusKPI Hiring Team
Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.
NOTICE: Please be aware of fraudulent emails regarding job postings, job offers and fake checks. FocusKPI's recruiting team will strictly reach out via @focuskpi.com email domain. If you have received fraudulent emails now or in the past, please report it to https://reportfraud.ftc.gov/ . The domain @focuskpijobs.com is fraudulent and not related to FocusKPI. Please do not not reply or communicate to anyone with @focuskpijobs.com.
Powered by JazzHR