Steampunk, Inc.
Join to apply for the
Senior Data Engineer - Databricks
role at
Steampunk, Inc.
In today’s rapidly evolving technology landscape, data is a strategic asset. Steampunk designs and executes data strategies for clients to coordinate data collection and generation, align data assets with mission goals, and realize outcomes with strong effectiveness. Our data exploitation approach is tightly integrated with Human-Centered Design and DevSecOps.
We are looking for a seasoned
Senior Data Engineer
to develop enterprise-grade data platforms, services, and pipelines in Databricks. We seek a technologist with excellent communication and customer service skills and a passion for data and problem solving.
Responsibilities
Lead and architect migrations of data using Databricks with focus on performance, reliability, and scalability.
Assess and understand ETL jobs, workflows, data marts, BI tools, and reports.
Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products.
Experience with database/data warehouse/data mart solutions in cloud (preferably AWS; Azure or GCP alternatives acceptable).
Key must-have skill sets – Databricks, SQL, PySpark/Python, AWS.
Support an Agile software development lifecycle.
Contribute to the growth of our AI & Data Exploitation Practice.
Qualifications
Required: Ability to hold a position of public trust with the US government.
5-7 years industry experience coding commercial software and a passion for solving complex problems.
5-7 years direct experience in Data Engineering with experience in tools such as: Databricks, Apache Spark, Delta Lake, etc.
Relational SQL (T-SQL preferred; other dialects acceptable).
Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc.
AWS cloud services: Databricks on AWS, S3, EC2, RDS (Azure equivalents acceptable).
Programming: PySpark/Python, Java, Scala, or similar.
Experience with Data Lakehouse architecture and Delta Lake/Apache Iceberg.
Advanced SQL knowledge and experience with relational databases, query optimization.
Experience manipulating large, diverse datasets and re-implementing data pipelines in Databricks.
Experience architecting data systems (transactional and data warehouses).
Experience with SDLC, CI/CD, and operating in dev/test/prod environments.
Experience with data cataloging tools is a plus (Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone).
Commitment to data governance and working in an Agile environment.
Experience supporting project teams of developers and data scientists who build web interfaces, dashboards, reports, and analytics/machine learning models.
About Steampunk Steampunk relies on factors such as geographic location, requirements, education, knowledge, skills, competencies, and experience to determine salary. The projected compensation range for this position is $140,000 to $180,000. The estimate represents a typical annual salary range and is one aspect of Steampunk’s total compensation package. Learn more about Steampunk benefits here.
Identity Statement: As part of the application process, you may be required to participate in identity verification during interviews and assessments.
Steampunk is a Change Agent in the Federal contracting industry, with a Human-Centered delivery methodology and employee ownership. For more about our story, visit http://www.steampunk.com.
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr
Senior Data Engineer - Databricks
role at
Steampunk, Inc.
In today’s rapidly evolving technology landscape, data is a strategic asset. Steampunk designs and executes data strategies for clients to coordinate data collection and generation, align data assets with mission goals, and realize outcomes with strong effectiveness. Our data exploitation approach is tightly integrated with Human-Centered Design and DevSecOps.
We are looking for a seasoned
Senior Data Engineer
to develop enterprise-grade data platforms, services, and pipelines in Databricks. We seek a technologist with excellent communication and customer service skills and a passion for data and problem solving.
Responsibilities
Lead and architect migrations of data using Databricks with focus on performance, reliability, and scalability.
Assess and understand ETL jobs, workflows, data marts, BI tools, and reports.
Address technical inquiries concerning customization, integration, enterprise architecture and general feature/functionality of data products.
Experience with database/data warehouse/data mart solutions in cloud (preferably AWS; Azure or GCP alternatives acceptable).
Key must-have skill sets – Databricks, SQL, PySpark/Python, AWS.
Support an Agile software development lifecycle.
Contribute to the growth of our AI & Data Exploitation Practice.
Qualifications
Required: Ability to hold a position of public trust with the US government.
5-7 years industry experience coding commercial software and a passion for solving complex problems.
5-7 years direct experience in Data Engineering with experience in tools such as: Databricks, Apache Spark, Delta Lake, etc.
Relational SQL (T-SQL preferred; other dialects acceptable).
Data pipeline and workflow management tools: Databricks Workflows, Airflow, Step Functions, etc.
AWS cloud services: Databricks on AWS, S3, EC2, RDS (Azure equivalents acceptable).
Programming: PySpark/Python, Java, Scala, or similar.
Experience with Data Lakehouse architecture and Delta Lake/Apache Iceberg.
Advanced SQL knowledge and experience with relational databases, query optimization.
Experience manipulating large, diverse datasets and re-implementing data pipelines in Databricks.
Experience architecting data systems (transactional and data warehouses).
Experience with SDLC, CI/CD, and operating in dev/test/prod environments.
Experience with data cataloging tools is a plus (Informatica EDC, Unity Catalog, Collibra, Alation, Purview, or DataZone).
Commitment to data governance and working in an Agile environment.
Experience supporting project teams of developers and data scientists who build web interfaces, dashboards, reports, and analytics/machine learning models.
About Steampunk Steampunk relies on factors such as geographic location, requirements, education, knowledge, skills, competencies, and experience to determine salary. The projected compensation range for this position is $140,000 to $180,000. The estimate represents a typical annual salary range and is one aspect of Steampunk’s total compensation package. Learn more about Steampunk benefits here.
Identity Statement: As part of the application process, you may be required to participate in identity verification during interviews and assessments.
Steampunk is a Change Agent in the Federal contracting industry, with a Human-Centered delivery methodology and employee ownership. For more about our story, visit http://www.steampunk.com.
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. Steampunk participates in the E-Verify program.
Seniority level
Mid-Senior level
Employment type
Full-time
Job function
Information Technology
Industries
IT Services and IT Consulting
#J-18808-Ljbffr