ZipRecruiter
Job Description
Description:
Hybrid | San Diego, CA
Our client, an industry leader in construction supply, has an excellent opportunity for a Senior Data Engineer to work in a full-time direct-hire position. Work will be a hybrid on-site/remote schedule in San Diego, CA. The Senior Data Engineer will bridge the gap between legacy systems and modern cloud platforms. You will play a crucial role in designing, building, and maintaining scalable data pipelines, ensuring seamless data processing for complex financial transactions, especially during month-end cycles. You'll collaborate closely with stakeholders and business teams, delivering impactful data solutions that drive strategic decisions.
This is a full-time, permanent opportunity, offering a competitive salary and comprehensive benefits package. Qualified applicants must be willing and able to work on a W2 basis.
Rate: $130,000-$150,000 annually
Responsibilities:
Design and Develop:
Build and maintain robust data pipelines and ETL processes using SSIS, Azure Data Factory, and Databricks. Migrate and Modernize:
Lead the migration of legacy ETL jobs to modern cloud platforms, ensuring scalability and maintainability. Cloud Integration:
Leverage Azure services to optimize data storage, processing, and analytics solutions. Collaboration:
Partner with business stakeholders to understand requirements and deliver data solutions that provide actionable insights. Performance Optimization:
Ensure high performance and reliability of data systems, optimizing processes for large-scale financial datasets. Innovation and Leadership:
Stay ahead of industry trends, champion best practices, and mentor junior engineers. API Integration:
Utilize APIs for seamless data integration and connectivity across systems. Data Quality:
Implement and maintain data quality standards to ensure the accuracy and reliability of data stored in the warehouse. Experience Requirements: Experience:
5+ years of hands-on experience in Data Engineering, with a strong background in ETL processes using SSIS, ADF or other ETL tools. Cloud Expertise:
Proven experience with Azure Cloud Services, including Azure Data Factory and Databricks. Database Proficiency:
Deep knowledge of SQL Server and other databases such as Postgres, MySQL etc., including complex query optimization and data modeling. Programming Skills:
Proficiency in Scripting such as Python, Bash, and/or PowerShell for data processing and transformation. Financial Domain Knowledge:
Understanding financial systems, especially Loan Servicing, is highly desirable. Stakeholder Engagement:
Excellent communication skills, with the ability to translate business requirements into technical solutions. Analytics Tools:
Familiarity with Power BI, Tableau, or other data visualization tools. API Integration:
Experience with APIs and data integration methods is a plus. Education Requirements: Bachelor's degree in Computer Science or equivalent.
#J-18808-Ljbffr
Build and maintain robust data pipelines and ETL processes using SSIS, Azure Data Factory, and Databricks. Migrate and Modernize:
Lead the migration of legacy ETL jobs to modern cloud platforms, ensuring scalability and maintainability. Cloud Integration:
Leverage Azure services to optimize data storage, processing, and analytics solutions. Collaboration:
Partner with business stakeholders to understand requirements and deliver data solutions that provide actionable insights. Performance Optimization:
Ensure high performance and reliability of data systems, optimizing processes for large-scale financial datasets. Innovation and Leadership:
Stay ahead of industry trends, champion best practices, and mentor junior engineers. API Integration:
Utilize APIs for seamless data integration and connectivity across systems. Data Quality:
Implement and maintain data quality standards to ensure the accuracy and reliability of data stored in the warehouse. Experience Requirements: Experience:
5+ years of hands-on experience in Data Engineering, with a strong background in ETL processes using SSIS, ADF or other ETL tools. Cloud Expertise:
Proven experience with Azure Cloud Services, including Azure Data Factory and Databricks. Database Proficiency:
Deep knowledge of SQL Server and other databases such as Postgres, MySQL etc., including complex query optimization and data modeling. Programming Skills:
Proficiency in Scripting such as Python, Bash, and/or PowerShell for data processing and transformation. Financial Domain Knowledge:
Understanding financial systems, especially Loan Servicing, is highly desirable. Stakeholder Engagement:
Excellent communication skills, with the ability to translate business requirements into technical solutions. Analytics Tools:
Familiarity with Power BI, Tableau, or other data visualization tools. API Integration:
Experience with APIs and data integration methods is a plus. Education Requirements: Bachelor's degree in Computer Science or equivalent.
#J-18808-Ljbffr