Sr. Data Engineering Lead, Onsite, VP

5 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. Who We Are Looking For ONSITE: Due to the role requirements, this job needs to be performed primarily in the office with some flex work opportunities available. Role Overview As a Data Engineer Lead, you will be responsible for developing, maintaining, and optimizing data pipelines and systems that support data acquisition, storage, transformation, and analysis. You will collaborate with cross-functional teams to ensure data availability, reliability, and integrity, requiring strong technical expertise in data engineering, database management, and programming. We seek candidates with good knowledge of Big Data technologies and strong experience with Databricks. You will assist in migrating on-prem applications to the cloud (Azure preferred) and create new data applications, working with a global team. Key Responsibilities Design, develop, and maintain data pipelines in Azure and Databricks Delta Lake, ensuring data quality and integrity. Implement efficient ELT/ETL processes, develop transformations, and integrate data from various sources for a unified view. Design data models and schemas supporting structured and unstructured data, optimizing for performance and scalability. Streamline data import/transformation processes using modern pipeline tools, ensuring efficiency and reliability. Work with teams to understand data needs and translate them into technical solutions. Monitor pipelines, troubleshoot issues, and ensure data security and compliance. Implement data quality controls, validate data, and enforce governance standards. Identify performance bottlenecks and optimize systems accordingly. Collaborate with data scientists, analysts, and engineers; document processes and configurations. Stay updated with industry trends and contribute to data infrastructure improvements. Support database and server management, query tuning, and data infrastructure in Azure. Desired Skills and Experience Hands-on experience with Azure services like Synapse, Data Factory, Databricks, SQL Database. Proficiency in data pipeline development, ETL/ELT, and data modeling. Strong SQL skills and programming experience in Scala or Java. Knowledge of relational and non-relational databases such as Snowflake, SQL Server, Oracle. Understanding of data warehousing, dimensional modeling, and best practices. Experience with version control systems like Git. Problem-solving skills and ability to work independently and in teams. Azzure certifications (Data Engineer Associate, Solutions Architect) are a plus. Excellent communication and collaboration skills. Qualifications Bachelor’s Degree in Computer Science or related field. 10+ years in IT, with 8+ years in Big Data data pipelines. Extensive experience as a Data Engineer, especially on Azure Databricks. Experience with cloud development, Azure services, DevOps, Kubernetes, Docker. Snowflake experience is a plus. Additional Requirements Effective communication skills, both written and oral. Positive attitude, teamwork, initiative, and self-motivation. Ability to multitask, learn quickly, and solve problems. Experience in the financial industry and agile methodologies. Why Join Us Our technology team drives digital transformation at State Street, leveraging cloud, AI, and automation to deliver insights. We value innovation, collaboration, and diversity, offering a supportive environment with growth opportunities. About State Street We are a leading custodian bank and asset manager, helping clients safeguard investments globally for over two centuries. We provide investment services, data analytics, research, and management. Benefits & Culture We offer competitive benefits, flexible work options, development programs, and a diverse, inclusive environment. We support work-life balance and community engagement. State Street is an equal opportunity employer.

#J-18808-Ljbffr