BDO USA
Lead Data Engineer - Tax Product Development
BDO USA - Chicago, Illinois, United States, 60601
Work at BDO USA
Overview
- View job
Overview
Lead Data Engineer, Tax Product Development
The Lead Data Engineer, Tax Product Development, works with the Data Engineering and Integration team to develop and support BDO's Tax Data Warehouse and Tax Data Lake, manage and maintain data ingestion and Extract/Transform/Load (ETL) processes, as well as provide support for the Power BI business intelligence platform and enterprise applications supporting the tax practice. The Lead Data Engineer builds and maintains tax data pipelines to support ad-hoc analytics and business intelligence applications as well as identify valuable development opportunities and ideas for improvement. This role collaborates closely with the data analytics teams to design, develop, and deploy new solutions that support strategic business priorities. Job Duties
Owns end-to-end delivery of large features and systems, defining technical requirements and architecture for data processing and integration solutions Leads design and implementation of major data structures and pipelines within an Agile team focused on data engineering solutions Designs, develops, and tests data products, pipelines, and solutions using web and cloud technologies for innovative data processing and analytics Applies modern software engineering principles throughout the software lifecycle for data-related applications, including ETL/ELT processes and database systems Reviews business requirements for technical feasibility, and collaborates with various teams, including internal developers and external peers, to deliver quality data integration solutions Mentors junior engineers to enhance code quality and ensure compliance with standards in data pipeline and analytics platform development Maintains data products and platforms based on product roadmaps, production support processes, and compliance with IT, security, and business mandates, ensuring data consistency, integrity, and scalability Effectively communicates with stakeholders and cross functional teams such as technical architects and security teams and others Other duties as required Supervisory Responsibilities
Acts as a direct supervisor to team members, as assigned Acts as a career advisor, as assigned Qualifications, Knowledge, Skills, and Abilities
Education: Bachelor's degree required; focus in Computer Science, Technology, Engineering, Mathematics (STEM), Finance, or Accounting, preferred Experience: Six (6) or more years of experience in a data engineer or related role, required Hands-on experience architecting, building, and optimizing large-scale relational (e.g., SQL Server, PostgreSQL, Oracle) and non-relational (e.g., CosmosDB, MongoDB, Cassandra, DynamoDB) databases to support both OLTP and OLAP workloads, preferred Experience writing and optimizing complex queries, stored procedures, functions, and triggers using SQL and comparable languages for high-volume transactional systems and analytical platforms, preferred Data Definition Language (DDL) and Data Manipulation Language (DML), with experience developing and maintaining database objects (tables, views, indexes, partitions) at scale, preferred Experience with data modeling principles, including normalization, denormalization, star and snowflake schema design, and semantic layer construction for enterprise data warehouses and data lakes, preferred Experience with design and implement ETL/ELT pipelines using modern data engineering frameworks and tools (e.g., Apache Spark, Databricks, Airflow, Talend, Informatica), preferred Experience implementing data governance, data quality, and data security best practices in large, distributed environments, preferred Tax experience, preferred Public accounting experience, preferred License/Certifications: Microsoft Azure Data Engineer, preferred Software: One or more programming languages such as Python, Java, C#, C++, or Scala, with a focus on data engineering applications, required Experience with the following products, preferred: Microsoft Office Suite Microsoft Azure DevOps or GitHub Microsoft SQL Server and/or Azure SQL DB Other Knowledge, Skills, & Abilities: Ability to work well in hybrid and remote environments Solid verbal and written communication skills Strong interpersonal and customer relationship skills, including training/instruction with professionals at all levels Sound decision-making skills Ability to work in a deadline-driven environment while handling multiple complex projects/tasks simultaneously with a focus on details Capable of successfully multi-tasking while working independently or within a group environment Ability to rely on extensive experience and judgment to plan and accomplish goals Capable of working well under pressure while dealing with unexpected problems in a professional manner Ability to communicate and interact with all levels of employees and management
The Lead Data Engineer, Tax Product Development, works with the Data Engineering and Integration team to develop and support BDO's Tax Data Warehouse and Tax Data Lake, manage and maintain data ingestion and Extract/Transform/Load (ETL) processes, as well as provide support for the Power BI business intelligence platform and enterprise applications supporting the tax practice. The Lead Data Engineer builds and maintains tax data pipelines to support ad-hoc analytics and business intelligence applications as well as identify valuable development opportunities and ideas for improvement. This role collaborates closely with the data analytics teams to design, develop, and deploy new solutions that support strategic business priorities. Job Duties
Owns end-to-end delivery of large features and systems, defining technical requirements and architecture for data processing and integration solutions Leads design and implementation of major data structures and pipelines within an Agile team focused on data engineering solutions Designs, develops, and tests data products, pipelines, and solutions using web and cloud technologies for innovative data processing and analytics Applies modern software engineering principles throughout the software lifecycle for data-related applications, including ETL/ELT processes and database systems Reviews business requirements for technical feasibility, and collaborates with various teams, including internal developers and external peers, to deliver quality data integration solutions Mentors junior engineers to enhance code quality and ensure compliance with standards in data pipeline and analytics platform development Maintains data products and platforms based on product roadmaps, production support processes, and compliance with IT, security, and business mandates, ensuring data consistency, integrity, and scalability Effectively communicates with stakeholders and cross functional teams such as technical architects and security teams and others Other duties as required Supervisory Responsibilities
Acts as a direct supervisor to team members, as assigned Acts as a career advisor, as assigned Qualifications, Knowledge, Skills, and Abilities
Education: Bachelor's degree required; focus in Computer Science, Technology, Engineering, Mathematics (STEM), Finance, or Accounting, preferred Experience: Six (6) or more years of experience in a data engineer or related role, required Hands-on experience architecting, building, and optimizing large-scale relational (e.g., SQL Server, PostgreSQL, Oracle) and non-relational (e.g., CosmosDB, MongoDB, Cassandra, DynamoDB) databases to support both OLTP and OLAP workloads, preferred Experience writing and optimizing complex queries, stored procedures, functions, and triggers using SQL and comparable languages for high-volume transactional systems and analytical platforms, preferred Data Definition Language (DDL) and Data Manipulation Language (DML), with experience developing and maintaining database objects (tables, views, indexes, partitions) at scale, preferred Experience with data modeling principles, including normalization, denormalization, star and snowflake schema design, and semantic layer construction for enterprise data warehouses and data lakes, preferred Experience with design and implement ETL/ELT pipelines using modern data engineering frameworks and tools (e.g., Apache Spark, Databricks, Airflow, Talend, Informatica), preferred Experience implementing data governance, data quality, and data security best practices in large, distributed environments, preferred Tax experience, preferred Public accounting experience, preferred License/Certifications: Microsoft Azure Data Engineer, preferred Software: One or more programming languages such as Python, Java, C#, C++, or Scala, with a focus on data engineering applications, required Experience with the following products, preferred: Microsoft Office Suite Microsoft Azure DevOps or GitHub Microsoft SQL Server and/or Azure SQL DB Other Knowledge, Skills, & Abilities: Ability to work well in hybrid and remote environments Solid verbal and written communication skills Strong interpersonal and customer relationship skills, including training/instruction with professionals at all levels Sound decision-making skills Ability to work in a deadline-driven environment while handling multiple complex projects/tasks simultaneously with a focus on details Capable of successfully multi-tasking while working independently or within a group environment Ability to rely on extensive experience and judgment to plan and accomplish goals Capable of working well under pressure while dealing with unexpected problems in a professional manner Ability to communicate and interact with all levels of employees and management