Logo
OSI Engineering

Data Pipeline Engineer

OSI Engineering, Mountain View, California, United States

Save Job

A global leader in consumer technology is looking for a talented Data Engineer to join its Cloud Services innovation group, focused on developing cutting-edge, cloud-based mobile applications and services. In this role, you’ll help design and build secure, scalable data infrastructure that powers AI-driven products used by millions worldwide. You’ll collaborate with world-class engineers to productize research projects and support robust, cloud-based platforms for mobile ecosystems. This is an exciting opportunity to shape the next generation of intelligent cloud services at the forefront of mobile innovation. Job Responsibilities: • Implement, maintain and evolve big data platform and infrastructure • Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system • Perform extensive research and analysis to make optimal architecture and design decisions • Write large amounts of code, perform code reviews, write unit tests and documentation • Interface with other groups including Product Management, QA and Operations • Create quick proof-of-concept prototypes • Work in a scrum team with ML & Cloud Engineers Candidate Requirements: • Hand-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & Kafka • Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis • Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking • Hands-on experience in building REST API’s • Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering • Desire to learn fast and pick up latest and greatest technologies • MS in Computer Science or equivalent experience Preferred: • Programming Language: Python • Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN • Machine Learning: PyTorch, TensorFlow, Spark ML • REST API: Flask, FastAPI, or Django • Data Quality tools such as Monte Carlo, Great Expectations, or Databand • Experience with teams using MLflow Type: Contract Duration: 12 months (with possibility to extend) Work Location: Mountain View, CA (on-site) Pay rate: $70.00 - $95.00 (DOE)