Logo
Purple Drive

Data Engineer

Purple Drive, New York, New York, us, 10261

Save Job

A Data Engineer with 8+ years' experience in data warehousing, complex data modeling, Snowflake, CI/CD, and strong SQL/PLSQL skills is responsible for architecting and maintaining robust data pipelines, optimizing large-scale storage, and ensuring high-quality data delivery to stakeholders.

Location - New york,NY Dallas & Plano,TX

Key Responsibilities

Design, build, and optimize data warehouses, including the creation and management of dimensions, facts, SCD (Slowly Changing Dimensions), historical and delta loads.

Perform thorough source system analysis and translate business requirements into scalable data models, involving new object creation or enhancements to existing schemas.

Develop, test, and maintain advanced SQL/PLSQL scripts for ETL processes and workflow automation.

Implement and monitor CI/CD processes using tools such as Jenkins and Bitbucket, promoting DevOps best practices.

Architect, develop, and support Snowflake data solutions, including hands-on loading/unloading data from external stages, managing time travel, RBAC, cloning, materialized views, and stored procedures.

Handle semi-structured data such as JSON/XML, as well as database views and basic performance tuning in Snowflake.

Collaborate directly with business stakeholders and customers to gather requirements, deliver data solutions, and present technical information clearly and effectively.

Maintain comprehensive technical documentation and adherence to regulatory and security requirements.

Essential Skills & Qualifications

Bachelor's or Master's in Computer Science, Engineering, or a related field.

8+ years' experience in data engineering, including advanced knowledge of data warehousing concepts and implementation.

Expertise in SQL/PLSQL, Snowflake architecture and features, and managing large, complex data sets.

Proficiency in ETL pipeline development, historical/delta data loads, and understanding of SCD techniques.

Strong experience with CI/CD processes, including hands-on Jenkins and Bitbucket use.

Demonstrated ability to analyze complex business requirements and translate into scalable data solutions.

Solid communication skills - both verbal and written, with experience presenting directly to customers.

Desired Skills

Working knowledge of additional cloud data platforms such as AWS or Azure.

Experience with parsing, transforming, and storing semi-structured data (JSON, XML) in Snowflake or other modern platforms.