gem-corp
Develop, maintain, and optimize data pipelines and ETL processes to ensure efficient data flow and integration
Work with structured and unstructured data from various sources
Data Management
Ensure data integrity, accuracy, and consistency across all data systems Implement and monitor data quality checks to maintain high standards of data quality Work closely with team members and other stakeholders to understand data requirements and deliver solutions Assist in integrating data from different sources into a unified data warehouse Performance Optimization
Optimize data processing workflows and database performance Identify and resolve data-related issues and bottlenecks Documentation
Create and maintain documentation for data pipelines, processes, and data models Required Skills and Experience
Bachelor’s degree in Computer Science, Engineering, or a related technical field. 4+ years of experience in Data Engineering or a similar role Proficiency in at least one programming language: Python, Java, or Scala Strong experience with SQL and relational databases (e.g., Oracle, MySQL, PostgreSQL, SQL Server) Hands-on experience with Big Data technologies such as Hadoop, Spark, and Kafka Proficiency with ETL and data integration tools (e.g., Talend, Airflow, Apache NiFi, Apache Hop, or Pentaho) Good understanding of APIs and experience integrating data through RESTful or streaming APIs Knowledge of cloud platforms (AWS, Azure, GCP) and their data-related services. Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery) Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes) Strong problem-solving, analytical, and debugging skills with high attention to detail Experience with version control systems (e.g., Git) and CI/CD pipelines Preferred Skills
Experience with
NoSQL databases
(e.g., MongoDB, Cassandra) Understanding of
machine learning
and
data analytics
concepts Good English communication is a plus Benefits
Salary: Up to 50M
Probation salary is 100% of the official salary 13th-month salary and performance review twice a year Bonus for special occasions each year (Labor Day, National Day, Solar New Year, Lunar New Year) Project bonus Employee’s professional certification and training allowances subject to company regulations Health Care Insurance Annual Health Assessment Social, health and unemployment insurance following government policy Enjoy company summer trips and other team building activities held monthly and quarterly Professional, creative and dynamic working environment Work five days per week with flexible check-in time Hotline: +842466666100 (Recruitment Team)
#J-18808-Ljbffr
Ensure data integrity, accuracy, and consistency across all data systems Implement and monitor data quality checks to maintain high standards of data quality Work closely with team members and other stakeholders to understand data requirements and deliver solutions Assist in integrating data from different sources into a unified data warehouse Performance Optimization
Optimize data processing workflows and database performance Identify and resolve data-related issues and bottlenecks Documentation
Create and maintain documentation for data pipelines, processes, and data models Required Skills and Experience
Bachelor’s degree in Computer Science, Engineering, or a related technical field. 4+ years of experience in Data Engineering or a similar role Proficiency in at least one programming language: Python, Java, or Scala Strong experience with SQL and relational databases (e.g., Oracle, MySQL, PostgreSQL, SQL Server) Hands-on experience with Big Data technologies such as Hadoop, Spark, and Kafka Proficiency with ETL and data integration tools (e.g., Talend, Airflow, Apache NiFi, Apache Hop, or Pentaho) Good understanding of APIs and experience integrating data through RESTful or streaming APIs Knowledge of cloud platforms (AWS, Azure, GCP) and their data-related services. Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift, BigQuery) Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes) Strong problem-solving, analytical, and debugging skills with high attention to detail Experience with version control systems (e.g., Git) and CI/CD pipelines Preferred Skills
Experience with
NoSQL databases
(e.g., MongoDB, Cassandra) Understanding of
machine learning
and
data analytics
concepts Good English communication is a plus Benefits
Salary: Up to 50M
Probation salary is 100% of the official salary 13th-month salary and performance review twice a year Bonus for special occasions each year (Labor Day, National Day, Solar New Year, Lunar New Year) Project bonus Employee’s professional certification and training allowances subject to company regulations Health Care Insurance Annual Health Assessment Social, health and unemployment insurance following government policy Enjoy company summer trips and other team building activities held monthly and quarterly Professional, creative and dynamic working environment Work five days per week with flexible check-in time Hotline: +842466666100 (Recruitment Team)
#J-18808-Ljbffr