LanceSoft
Title: Data Engineer
Duration: 12 months
Work Hours: 37.5hrs/week
Location: Quincy, MA 02171
Position: Hybrid
Pay Rate: $70.00-75.00 per hour
Enter Job Description...
Involve in Design and development of cloud-based data management systems. Proficiency and practical experience in Design and implementation of data pipelines in both centralized and decentralized Data architectures. Ensures established data security policies and standards are followed while designing data solution for cloud-based platforms. Collaborates with cross-functional teams to architect highly scalable, highly available, and highly performant cloud data solutions. Evaluates and recommends new cloud products and services for efficient data curation, storage and processing. Monitors the performance of cloud data solutions and strategizes optimization measures. Ensures compliance with data governance policies and best practices in the cloud. Implements data management and data governance processes for cloud data. Conducts thorough analysis and documentation of cloud data engineering strategies and designs. Establish regular overall system performance assessment processes and action plans. Expertise in Data Integration leveraging Informatica (IICS), Snowflake, SQL and Python code to solve complex use cases Provide direction for the design and development of the data layers including review of ETL requirements. Capable of leading team design sessions and facilitating decisions. Ensure timely delivery of solutions meeting requirements and expectations Qualifications:
Minimum experience/skills:
5+ years of experience in Design and development of Data pipelines, Cloud Data Architecture, Data warehousing, Data modeling, ETL, enterprise and business information system architectures, and system engineering Thorough knowledge and Implementation experience of data warehouse and Enterprise Data architecture principles, specifically Decentralized data architectures like Data Mesh. 3-5 years of experience developing Cloud-based (AWS) data solutions. 5+ years of Cloud database platform experience such as Snowflake. Experience in creating and maintaining end-to-end data pipelines. Strong communication skills comfortable explaining/proposing solutions to technical stakeholders, vendors, and business consumers. Proficiency with Unix, Linux, and shell scripting Experience working with a large, multi-terabyte enterprise data platform in Cloud. Clear understanding on system administration, database administration, storage architectures, backup & recovery, and networking. 3-5 years of experience in Informatica (IICS) ETL, GitHub(CI/CD) and Airflow (Orchestration) experience. Experience working with highly sensitive health care information and familiar with HIP nd other data privacy controls.
EEO Employer LanceSoft is a certified Minority Business Enterprise (MBE) and an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. LanceSoft makes hiring decisions based solely on qualifications, merit, and business needs at the time.
Enter Job Description...
Involve in Design and development of cloud-based data management systems. Proficiency and practical experience in Design and implementation of data pipelines in both centralized and decentralized Data architectures. Ensures established data security policies and standards are followed while designing data solution for cloud-based platforms. Collaborates with cross-functional teams to architect highly scalable, highly available, and highly performant cloud data solutions. Evaluates and recommends new cloud products and services for efficient data curation, storage and processing. Monitors the performance of cloud data solutions and strategizes optimization measures. Ensures compliance with data governance policies and best practices in the cloud. Implements data management and data governance processes for cloud data. Conducts thorough analysis and documentation of cloud data engineering strategies and designs. Establish regular overall system performance assessment processes and action plans. Expertise in Data Integration leveraging Informatica (IICS), Snowflake, SQL and Python code to solve complex use cases Provide direction for the design and development of the data layers including review of ETL requirements. Capable of leading team design sessions and facilitating decisions. Ensure timely delivery of solutions meeting requirements and expectations Qualifications:
Minimum experience/skills:
5+ years of experience in Design and development of Data pipelines, Cloud Data Architecture, Data warehousing, Data modeling, ETL, enterprise and business information system architectures, and system engineering Thorough knowledge and Implementation experience of data warehouse and Enterprise Data architecture principles, specifically Decentralized data architectures like Data Mesh. 3-5 years of experience developing Cloud-based (AWS) data solutions. 5+ years of Cloud database platform experience such as Snowflake. Experience in creating and maintaining end-to-end data pipelines. Strong communication skills comfortable explaining/proposing solutions to technical stakeholders, vendors, and business consumers. Proficiency with Unix, Linux, and shell scripting Experience working with a large, multi-terabyte enterprise data platform in Cloud. Clear understanding on system administration, database administration, storage architectures, backup & recovery, and networking. 3-5 years of experience in Informatica (IICS) ETL, GitHub(CI/CD) and Airflow (Orchestration) experience. Experience working with highly sensitive health care information and familiar with HIP nd other data privacy controls.
EEO Employer LanceSoft is a certified Minority Business Enterprise (MBE) and an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, sex, religion, sexual orientation, national origin, disability, genetic information, pregnancy, or any other protected characteristic as outlined by federal, state, or local laws. This policy applies to all employment practices within our organization, including hiring, recruiting, promotion, termination, layoff, recall, leave of absence, compensation, benefits, training, and apprenticeship. LanceSoft makes hiring decisions based solely on qualifications, merit, and business needs at the time.