Transition Technologies PSC
Snowflake Developer/Data Engineer
Transition Technologies PSC, Snowflake, Arizona, United States, 85937
What will you do?
Responsibilities : Design, build, and maintain scalable data pipelines (ETL/ELT) leveraging Snowflake and Airflow Implement optimized schemas, partitioning, and indexing strategies in Snowflake and relational databases Develop data processing workflows and automation scripts in Python and SQL; integrate with APIs and microservices Ensure scalability, performance, and resilience of pipelines; implement observability for jobs and data flows Partner with data scientists and ML engineers to deliver high-quality datasets optimized for AI/ML workloads Prepare, transform, and manage datasets for embeddings, RAG workflows, and LLM fine-tuning Who are we looking for?
Requirements : Experience: A minimum of 5-7+ years in data engineering, preferably supporting AI/ML applications and hold B.Sc., B.Eng., or higher, or equivalent in Computer Science, Data Engineering or related fields Experience with Snowflake Programming: Proficiency in Python, SQL and vector database native languages Databases: Experience with relational databases Cloud Platforms: Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation) ETL/ELT Pipelines: Experience building scalable ETL/ELT workflows using dbt, Apache Airflow, or similar APIs & Microservices: Ability to design and integrate RESTful APIs for data exchange Data Security & Governance: Understanding of encryption and role-based access controls Version Control & DevOps: Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation) Generative AI Support: Experience working with AI-specific data needs, such as embeddings, RAG (Retrieval Augmented Generation), and LLM fine-tuning data preparation Nice to have : Why is it worth it?
What can we offer : Flexible forms of employment and working hours (CoE or B2B) An interesting, challenging job in the dynamically developing Capital Group company; Work on innovative projects using modern technologies; Direct impact on shaping the image of the Capital Group’s companies on the market; Possibility to develop competences in a wide range; Stability of employment and a friendly work atmosphere; Cool benefits, among others integration meetings, internal company competitions, fruit Tuesdays, sweet Thursdays and much more;
#J-18808-Ljbffr
Responsibilities : Design, build, and maintain scalable data pipelines (ETL/ELT) leveraging Snowflake and Airflow Implement optimized schemas, partitioning, and indexing strategies in Snowflake and relational databases Develop data processing workflows and automation scripts in Python and SQL; integrate with APIs and microservices Ensure scalability, performance, and resilience of pipelines; implement observability for jobs and data flows Partner with data scientists and ML engineers to deliver high-quality datasets optimized for AI/ML workloads Prepare, transform, and manage datasets for embeddings, RAG workflows, and LLM fine-tuning Who are we looking for?
Requirements : Experience: A minimum of 5-7+ years in data engineering, preferably supporting AI/ML applications and hold B.Sc., B.Eng., or higher, or equivalent in Computer Science, Data Engineering or related fields Experience with Snowflake Programming: Proficiency in Python, SQL and vector database native languages Databases: Experience with relational databases Cloud Platforms: Hands-on experience with AWS (OpenSearch, S3, Lambda) or Azure (Azure AI Search, Azure Blob Storage, Azure Automation) ETL/ELT Pipelines: Experience building scalable ETL/ELT workflows using dbt, Apache Airflow, or similar APIs & Microservices: Ability to design and integrate RESTful APIs for data exchange Data Security & Governance: Understanding of encryption and role-based access controls Version Control & DevOps: Familiarity with Git, CI/CD, containerization (Docker, Kubernetes), and Infrastructure as Code (Terraform, CloudFormation) Generative AI Support: Experience working with AI-specific data needs, such as embeddings, RAG (Retrieval Augmented Generation), and LLM fine-tuning data preparation Nice to have : Why is it worth it?
What can we offer : Flexible forms of employment and working hours (CoE or B2B) An interesting, challenging job in the dynamically developing Capital Group company; Work on innovative projects using modern technologies; Direct impact on shaping the image of the Capital Group’s companies on the market; Possibility to develop competences in a wide range; Stability of employment and a friendly work atmosphere; Cool benefits, among others integration meetings, internal company competitions, fruit Tuesdays, sweet Thursdays and much more;
#J-18808-Ljbffr