Children's National Hospital
Senior Data Engineer
Children's National Hospital, Silver Spring, Maryland, United States, 20900
Overview
The Senior Data Engineer is responsible for designing, developing, and operationalizing advanced cloud data pipelines to facilitate seamless data consumption for reports, advanced analytics, and AI initiatives. This role involves overseeing the entire data lifecycle, including data ingestion, transformation, validation, and quality assurance. The Senior Data Engineer ensures the optimization and orchestration of data pipelines to handle high-volume and high-performance requirements effectively. In addition to cloud-native engineering, this role plays a critical part in data modernization efforts, including data migrations from legacy systems into modern electric health record systems, developing and managing data extracts and conversions, and ensuring alignment within a standard data architecture. A strong understanding of HL7 interfaces is essential to support interoperability and real-time data exchange across clinical systems. The Senior Data Engineer also leads efforts in Continuous Integration and Continuous Deployment (CI/CD), driving automation and deployment efficiency. They collaborate with cross-functional teams to align data solutions with business needs, provide strategic insights, and mentor junior team members, all while upholding best practices and ensuring data integrity. Qualifications and Skills
Minimum Education:
Bachelor’s Degree in a quantitative or business field (e.g., Statistics, Mathematics, Engineering, Computer Science). (Required) Minimum Work Experience:
6 years – Requires deep functional knowledge with 6+ years of related experience or equivalent experience reflecting the responsibilities of this position. (Required) Required Skills/Knowledge:
Experience with big data; data processing and cloud technologies. Strong experience diagnosing system issues, engaging in data validation, and providing quality assurance testing. Experience with data manipulation; data mining. Experience working in production cloud infrastructure. Experience with C#, Java, Python, SQL; programming concepts, tools, and related knowledge. Knowledge of Microsoft Azure; Databricks or equivalent. Desires to acquire knowledge in the area of specialty. Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions. Ability to work independently. Demonstrated analytical skills. Demonstrated project management skills. Demonstrates a high level of accuracy, even under pressure. Excellent judgment and decision-making skills. Great verbal and written communication skills; ability to communicate complex findings clearly. Facilitation skills to host sessions and elicit ideas, understanding issues and encouraging group participation. Attention to detail. Collaborate effectively with cross-functional teams. Adapt to changing priorities and thrive in a dynamic environment. Functional Accountabilities: Guides the design and implementation of complex data management procedures around data staging, ingestion, preparation, provisioning, destruction, with scripts and automation. Provides guidance to data engineering in the design, development, implementation, testing, documentation, and preparation of large scale, high-volume, high-performance data structures for business intelligence analysts. Designs, develops, and maintains real-time processing applications and real-time data pipelines. Ensures quality of technical solutions as data moves across environments. Provides senior-level knowledge and insight into the changing cloud data environment, data processing, data storage, and utilization requirements, guiding the team toward viable solutions. Develops, constructs, tests, and maintains architectures using advanced programming languages and tools. Drives improvements in data reliability, efficiency, and quality and deploys solutions; identifies tasks that can be automated. Performs other duties as assigned. Complies with all policies and standards.
#J-18808-Ljbffr
The Senior Data Engineer is responsible for designing, developing, and operationalizing advanced cloud data pipelines to facilitate seamless data consumption for reports, advanced analytics, and AI initiatives. This role involves overseeing the entire data lifecycle, including data ingestion, transformation, validation, and quality assurance. The Senior Data Engineer ensures the optimization and orchestration of data pipelines to handle high-volume and high-performance requirements effectively. In addition to cloud-native engineering, this role plays a critical part in data modernization efforts, including data migrations from legacy systems into modern electric health record systems, developing and managing data extracts and conversions, and ensuring alignment within a standard data architecture. A strong understanding of HL7 interfaces is essential to support interoperability and real-time data exchange across clinical systems. The Senior Data Engineer also leads efforts in Continuous Integration and Continuous Deployment (CI/CD), driving automation and deployment efficiency. They collaborate with cross-functional teams to align data solutions with business needs, provide strategic insights, and mentor junior team members, all while upholding best practices and ensuring data integrity. Qualifications and Skills
Minimum Education:
Bachelor’s Degree in a quantitative or business field (e.g., Statistics, Mathematics, Engineering, Computer Science). (Required) Minimum Work Experience:
6 years – Requires deep functional knowledge with 6+ years of related experience or equivalent experience reflecting the responsibilities of this position. (Required) Required Skills/Knowledge:
Experience with big data; data processing and cloud technologies. Strong experience diagnosing system issues, engaging in data validation, and providing quality assurance testing. Experience with data manipulation; data mining. Experience working in production cloud infrastructure. Experience with C#, Java, Python, SQL; programming concepts, tools, and related knowledge. Knowledge of Microsoft Azure; Databricks or equivalent. Desires to acquire knowledge in the area of specialty. Ability to identify basic problems and procedural irregularities, collect data, establish facts, and draw valid conclusions. Ability to work independently. Demonstrated analytical skills. Demonstrated project management skills. Demonstrates a high level of accuracy, even under pressure. Excellent judgment and decision-making skills. Great verbal and written communication skills; ability to communicate complex findings clearly. Facilitation skills to host sessions and elicit ideas, understanding issues and encouraging group participation. Attention to detail. Collaborate effectively with cross-functional teams. Adapt to changing priorities and thrive in a dynamic environment. Functional Accountabilities: Guides the design and implementation of complex data management procedures around data staging, ingestion, preparation, provisioning, destruction, with scripts and automation. Provides guidance to data engineering in the design, development, implementation, testing, documentation, and preparation of large scale, high-volume, high-performance data structures for business intelligence analysts. Designs, develops, and maintains real-time processing applications and real-time data pipelines. Ensures quality of technical solutions as data moves across environments. Provides senior-level knowledge and insight into the changing cloud data environment, data processing, data storage, and utilization requirements, guiding the team toward viable solutions. Develops, constructs, tests, and maintains architectures using advanced programming languages and tools. Drives improvements in data reliability, efficiency, and quality and deploys solutions; identifies tasks that can be automated. Performs other duties as assigned. Complies with all policies and standards.
#J-18808-Ljbffr