Petlibro
Senior Data Engineer/ Data Engineering Architect
Petlibro, San Jose, California, United States, 95199
Overview
Join to apply for the
Senior Data Engineer/ Data Engineering Architect
role at
Petlibro . Responsibilities
Design robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices. Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes. Design and build a data validation framework to guarantee the accuracy and consistency of data across all stages of the pipeline, ensuring reliable insights and decision-making. Implement data architectures to continuously improve AI models through automated feedback loops and data collection processes. Optimize data processing workflows for AIoT tasks. Collaborate with product owners to translate data requirements into actionable data engineering solutions. Collaborate with other engineers, product owners to solve challenging problems. Evangelize software engineering best practices and lead by example. Qualifications
Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. 5+ years of proven experience in data engineering, with a strong focus on data warehousing and data system architecture. Expertise in design and build IoT data systems. Expertise in architecting that power high-volume consumer application. Expertise in big data and streaming technologies (Python, Java, Kafka, Spark, Spark Streaming). Expertise in modern database technology (MongoDB, ElasticSearch, StarRocks, S3, Snowflake, BigQuery etc). Experience with data annotation tools and processes for machine learning datasets. Familiarity with MLOps practices and tools for managing AI model lifecycles. Knowledge about deploying systems into a production Cloud Native Environment (AWS or similar). Experience in Java Spring Framework is a plus Experience with video data handling and image processing is a plus Benefits
401(k) 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Wellness resources Employment type
Full-time
#J-18808-Ljbffr
Join to apply for the
Senior Data Engineer/ Data Engineering Architect
role at
Petlibro . Responsibilities
Design robust and scalable data system architecture to collect, process, and store large volumes of data from IoT devices. Design and build data systems that support real-time, customer facing data applications, ensuring data integrity and efficient retrieval processes. Design and build a data validation framework to guarantee the accuracy and consistency of data across all stages of the pipeline, ensuring reliable insights and decision-making. Implement data architectures to continuously improve AI models through automated feedback loops and data collection processes. Optimize data processing workflows for AIoT tasks. Collaborate with product owners to translate data requirements into actionable data engineering solutions. Collaborate with other engineers, product owners to solve challenging problems. Evangelize software engineering best practices and lead by example. Qualifications
Bachelor's degree in Computer Science, Data Science, Engineering, or a related field. 5+ years of proven experience in data engineering, with a strong focus on data warehousing and data system architecture. Expertise in design and build IoT data systems. Expertise in architecting that power high-volume consumer application. Expertise in big data and streaming technologies (Python, Java, Kafka, Spark, Spark Streaming). Expertise in modern database technology (MongoDB, ElasticSearch, StarRocks, S3, Snowflake, BigQuery etc). Experience with data annotation tools and processes for machine learning datasets. Familiarity with MLOps practices and tools for managing AI model lifecycles. Knowledge about deploying systems into a production Cloud Native Environment (AWS or similar). Experience in Java Spring Framework is a plus Experience with video data handling and image processing is a plus Benefits
401(k) 401(k) matching Dental insurance Health insurance Paid time off Vision insurance Wellness resources Employment type
Full-time
#J-18808-Ljbffr