Dynamed Solutions, LLC
Data Engineer
Dynamed Solutions, LLC - Columbia, Maryland, United States, 21046
Work at Dynamed Solutions, LLC
Overview
- View job
Overview
Join to apply for the
Data Engineer
role at
Dynamed Solutions, LLC Join to apply for the
Data Engineer
role at
Dynamed Solutions, LLC Position Title: Data Engineer - CRISP Insights
Reports Directly To:
Senior Data Engineer Technical Lead
Location:
Columbia, MD
Hours Per Week:
40
Risk Designation:
High
Job Summary
The Data Engineer will be responsible for supporting HIT activities in the Baltimore/Washington region. The successful candidate will work to design, develop, and maintain a data analytics platform solution. CRISP Shared Services is currently running an Azure Data Lake 2 / Azure Data Factory / Spark / Databricks infrastructure with approximately 300 production use cases that consolidate several streams of healthcare data. This role will primarily focus on the creation of new use cases through Databricks programming including communication, technical proficiency, collaboration, and willingness to learn new things. This role assists a senior data engineer to implement new ingestion pipelines and troubleshoot production issues.
This position will have a base salary.
This position requires the candidate to be in the Columbia office 1 day a week.
Essential Duties And Responsibilities
Include the following. Other duties may be assigned.
Design, build, and maintain large, complex data processing pipelines that meet business requirements Ensure the quality of deliverables by developing automated controls and performing unit, integration, and user acceptance testing Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Troubleshoot and perform root cause analysis on data pipeline issues Work with source system owners and business owners to incorporate business changes into data pipelines Create comprehensive documentation of data workflows, processes, and infrastructure
Qualifications
To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Advanced programming skills in PySpark, Python, Spark SQL Thorough understanding of Data Lakes, raw/enriched/curated layer concepts, and ETL within Azure framework Proven development experience in building complex data pipelines for lakehouse/data warehouses using Agile methodology Experience in architecture, design, and implementation using Databricks and Azure Data Factory
Required Experience/Education
4+ year college degree (required) 4+ years of working with data integration (required) 2+ years of advanced programming in PySpark Experience working with Databricks (preferred) Seniority level
Seniority level
Mid-Senior level Employment type
Employment type
Full-time Job function
Job function
Information Technology Industries
IT Services and IT Consulting Referrals increase your chances of interviewing at Dynamed Solutions, LLC by 2x Get notified about new Data Engineer jobs in
Columbia, MD . Rockville, MD $55,000.00-$125,000.00 1 month ago Fort Meade, MD $12,000.00-$150,000.00 1 month ago Washington, DC $75,000.00-$90,000.00 4 months ago Hanover, MD $49,996.80-$290,004.00 5 days ago Hanover, MD $78,000.00-$250,000.00 3 weeks ago Junior Full Stack Software Engineer (Part-Time/Internship)
Junior Full Stack Software Engineer (JAVA)
Hanover, MD $78,000.00-$250,000.00 5 days ago Columbia, MD $80,000.00-$140,000.00 5 months ago Annapolis Junction, MD $130,000.00-$270,000.00 1 week ago Fort Meade, MD $70,000.00-$100,000.00 1 month ago Junior Software Engineer - Fully Cleared (Prime)
Annapolis Junction, MD $127,000.00-$167,000.00 2 weeks ago Columbia, MD $50,000.00-$120,000.00 1 year ago Gaithersburg, MD $67,600.00-$122,200.00 23 hours ago Annapolis Junction, MD $130,000.00-$270,000.00 1 day ago Washington DC-Baltimore Area 3 months ago Annapolis Junction, MD $50,000.00-$120,000.00 5 months ago Hanover, MD $78,000.00-$250,000.00 11 hours ago Junior F/E Software Engineer (Hybrid) - 23684
Columbia, MD $89,769.00-$130,000.00 2 weeks ago Hanover, MD $78,000.00-$250,000.00 5 days ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr
Data Engineer
role at
Dynamed Solutions, LLC Join to apply for the
Data Engineer
role at
Dynamed Solutions, LLC Position Title: Data Engineer - CRISP Insights
Reports Directly To:
Senior Data Engineer Technical Lead
Location:
Columbia, MD
Hours Per Week:
40
Risk Designation:
High
Job Summary
The Data Engineer will be responsible for supporting HIT activities in the Baltimore/Washington region. The successful candidate will work to design, develop, and maintain a data analytics platform solution. CRISP Shared Services is currently running an Azure Data Lake 2 / Azure Data Factory / Spark / Databricks infrastructure with approximately 300 production use cases that consolidate several streams of healthcare data. This role will primarily focus on the creation of new use cases through Databricks programming including communication, technical proficiency, collaboration, and willingness to learn new things. This role assists a senior data engineer to implement new ingestion pipelines and troubleshoot production issues.
This position will have a base salary.
This position requires the candidate to be in the Columbia office 1 day a week.
Essential Duties And Responsibilities
Include the following. Other duties may be assigned.
Design, build, and maintain large, complex data processing pipelines that meet business requirements Ensure the quality of deliverables by developing automated controls and performing unit, integration, and user acceptance testing Develop scalable and re-usable frameworks for ingestion and transformation of large data sets Troubleshoot and perform root cause analysis on data pipeline issues Work with source system owners and business owners to incorporate business changes into data pipelines Create comprehensive documentation of data workflows, processes, and infrastructure
Qualifications
To perform this job successfully, the incumbent must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Advanced programming skills in PySpark, Python, Spark SQL Thorough understanding of Data Lakes, raw/enriched/curated layer concepts, and ETL within Azure framework Proven development experience in building complex data pipelines for lakehouse/data warehouses using Agile methodology Experience in architecture, design, and implementation using Databricks and Azure Data Factory
Required Experience/Education
4+ year college degree (required) 4+ years of working with data integration (required) 2+ years of advanced programming in PySpark Experience working with Databricks (preferred) Seniority level
Seniority level
Mid-Senior level Employment type
Employment type
Full-time Job function
Job function
Information Technology Industries
IT Services and IT Consulting Referrals increase your chances of interviewing at Dynamed Solutions, LLC by 2x Get notified about new Data Engineer jobs in
Columbia, MD . Rockville, MD $55,000.00-$125,000.00 1 month ago Fort Meade, MD $12,000.00-$150,000.00 1 month ago Washington, DC $75,000.00-$90,000.00 4 months ago Hanover, MD $49,996.80-$290,004.00 5 days ago Hanover, MD $78,000.00-$250,000.00 3 weeks ago Junior Full Stack Software Engineer (Part-Time/Internship)
Junior Full Stack Software Engineer (JAVA)
Hanover, MD $78,000.00-$250,000.00 5 days ago Columbia, MD $80,000.00-$140,000.00 5 months ago Annapolis Junction, MD $130,000.00-$270,000.00 1 week ago Fort Meade, MD $70,000.00-$100,000.00 1 month ago Junior Software Engineer - Fully Cleared (Prime)
Annapolis Junction, MD $127,000.00-$167,000.00 2 weeks ago Columbia, MD $50,000.00-$120,000.00 1 year ago Gaithersburg, MD $67,600.00-$122,200.00 23 hours ago Annapolis Junction, MD $130,000.00-$270,000.00 1 day ago Washington DC-Baltimore Area 3 months ago Annapolis Junction, MD $50,000.00-$120,000.00 5 months ago Hanover, MD $78,000.00-$250,000.00 11 hours ago Junior F/E Software Engineer (Hybrid) - 23684
Columbia, MD $89,769.00-$130,000.00 2 weeks ago Hanover, MD $78,000.00-$250,000.00 5 days ago Were unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr