Sota Tek
Responsibilities
Design, develop, and maintain scalable data pipelines and ETL processes.
Implement and optimize data storage solutions, including data warehouses and data lakes.
Collaborate with data scientists and analysts to understand data requirements and provide efficient data access methods.
Ensure data quality, consistency, and security across all data platforms.
Develop and maintain data models, schemas, and data dictionaries.
Implement data governance policies and procedures.
Optimize query performance and data retrieval processes.
Integrate various data sources and APIs into our data ecosystem.
Automate data workflows and implement monitoring and alerting systems.
Stay up-to-date with emerging technologies and recommend improvements to our data architecture.
Requirements
Must have Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering or similar roles. Certifications in relevant data platforms or cloud technologies (AWS, GG, Azure, Databrick, Dataiku, Snowflake) Strong programming skills in Python, Scala, or Java. Extensive experience with SQL, NoSQL, Vector databases Experience with ELT/ETL open source frameworks (DBT, Fivetran) Proficiency in big data technologies (e.g., Hadoop, Spark, Hive). Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services. Experience with data modeling, data warehousing concepts, and dimensional modeling. Familiarity with data visualization tools (e.g., Tableau, Power BI). Experience with version control systems (e.g., Git) and CI/CD pipelines. Experienced in working with large ERP systems and has participated in building ETL pipelines from the analysis and design phases. Flexible, with strong problem-solving skills and attention to detail.
Nice to have
Experience with streaming data processing (e.g., Kafka, Flink). Knowledge of machine learning pipelines and MLOps practices. Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes). Familiarity with other data analytics tools such as Power BI, Tableau, etc. Experience with data governance and compliance requirements (e.g., GDPR, CCPA). Experience with database migration projects Certifications in relevant data platforms or cloud technologies (AWS, GG, Azure, Databrick, Dataiku)
#J-18808-Ljbffr
Requirements
Must have Bachelor's or Master's degree in Computer Science, Engineering, or a related field. 5+ years of experience in data engineering or similar roles. Certifications in relevant data platforms or cloud technologies (AWS, GG, Azure, Databrick, Dataiku, Snowflake) Strong programming skills in Python, Scala, or Java. Extensive experience with SQL, NoSQL, Vector databases Experience with ELT/ETL open source frameworks (DBT, Fivetran) Proficiency in big data technologies (e.g., Hadoop, Spark, Hive). Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services. Experience with data modeling, data warehousing concepts, and dimensional modeling. Familiarity with data visualization tools (e.g., Tableau, Power BI). Experience with version control systems (e.g., Git) and CI/CD pipelines. Experienced in working with large ERP systems and has participated in building ETL pipelines from the analysis and design phases. Flexible, with strong problem-solving skills and attention to detail.
Nice to have
Experience with streaming data processing (e.g., Kafka, Flink). Knowledge of machine learning pipelines and MLOps practices. Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes). Familiarity with other data analytics tools such as Power BI, Tableau, etc. Experience with data governance and compliance requirements (e.g., GDPR, CCPA). Experience with database migration projects Certifications in relevant data platforms or cloud technologies (AWS, GG, Azure, Databrick, Dataiku)
#J-18808-Ljbffr