InterSources
Job Summary - Data Engineer:
We are seeking a skilled mid-level+ Data Engineer to join our team and focus on quality assurance, quality checking, and ETL processes. The successful candidate will be responsible for ensuring the integrity and accuracy of data transferred from a shared file transfer service to an S3 bucket and subsequently into and through our Snowflake data platform. This data will be utilized by downstream applications and reporting systems. These applications and the corresponding consumed data are critical to business process execution.
Key Responsibilities:
Quality Assurance & Quality Checking : Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process. ETL Processes : Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake. Data Integration : Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools. Data Quality Management : Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts. Collaboration : Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions. Monitoring & Troubleshooting : To preserve data flow and integrity, monitor pipelines, identify issues, and implement solutions. Qualifications (Knowledge/Skills/Abilities):
Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes. Expertise in Python, PyPI, and SQL Expert analytical and problem-solving skills. Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity. Understanding of fundamental public-cloud capabilities. Proven capacity to comprehend business needs and convert them into technical requirements. Demonstrated excellence in communication and collaboration abilities. Proven capacity to define success, deliver, and operate in an agile setting.
Skill Required / Desired mount of Experience Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes. Required 5 Years Expertise in Python, PyPI, and SQL Required 5 Years Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity. Required 5 Years Understanding of fundamental public-cloud capabilities. Required 5 Years Proven capacity to comprehend business needs and convert them into technical requirements. Required 5 Years
About Us: InterSources Inc , a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering
Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services,
etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a
Google Cloud partner
company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.
Quality Assurance & Quality Checking : Implement and maintain data quality to ensure the accuracy and reliability of data throughout the ETL process. ETL Processes : Design, develop, and optimize ETL workflows to efficiently transfer data from file transfer services to S3 buckets and Snowflake. Data Integration : Ensure seamless data integration into data platform, enabling efficient consumption by downstream applications and reporting tools. Data Quality Management : Address data quality challenges, including inconsistencies in source data that do not meet ingestion requirements, which can lead to load failures or data backouts. Collaboration : Work closely with business owners, data analysts, business intelligence teams, and other stakeholders to understand data requirements and deliver high-quality data solutions. Monitoring & Troubleshooting : To preserve data flow and integrity, monitor pipelines, identify issues, and implement solutions. Qualifications (Knowledge/Skills/Abilities):
Demonstrated mid-level+ experience in data engineering, with a emphasis on data quality assurance and ETL processes. Expertise in Python, PyPI, and SQL Expert analytical and problem-solving skills. Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity. Understanding of fundamental public-cloud capabilities. Proven capacity to comprehend business needs and convert them into technical requirements. Demonstrated excellence in communication and collaboration abilities. Proven capacity to define success, deliver, and operate in an agile setting.
Skill Required / Desired mount of Experience Demonstrated mid-level+ experience in data engineering, with an emphasis on data quality assurance and ETL processes. Required 5 Years Expertise in Python, PyPI, and SQL Required 5 Years Demonstrate a strong understanding of cybersecurity principles related to code development, DevOps, data access, and fundamental cybersecurity. Required 5 Years Understanding of fundamental public-cloud capabilities. Required 5 Years Proven capacity to comprehend business needs and convert them into technical requirements. Required 5 Years
About Us: InterSources Inc , a Certified Diverse Supplier, was founded in 2007 and offers innovative solutions to help clients with Digital Transformations across various domains and industries. Our history spans over 16 years and today we are an Award-Winning Global Software Consultancy solving complex problems with technology. We recognize that our employees and our clients are our strengths as the diverse talents and opportunities they bring to the table enable us to grow as a global platform and they are causally linked with our success. We provide strategic and technical advice, and we have expertise in areas covering
Artificial Intelligence, Cloud Migration, Custom Software Development, Data Analytics Infrastructure & Cloud Solutions, Cyber Security Services,
etc. We make reasonable accommodations for clients and employees and we do not discriminate based on any protected attribute including race, religion, color, national origin, gender sexual orientation, gender identity, age, or marital status. We also are a
Google Cloud partner
company. We align strategy with execution and provide secure service solutions by developing and using the latest technologies that thrive our resources to deliver industry-leading capabilities to our clients and customers, making it convenient for our clients to do business with InterSources Inc. Our teams also drive growth by refining technology-driven client experiences that put the users first, providing an unparalleled experience. This results in strengthening the core technologies of clients, enabling them to scale with flexibility, create seamless digital experiences and build lifelong relationships.