Logo
Dexian

Data Engineer IV

Dexian, Raleigh, North Carolina, United States

Save Job

Overview

Job Role :: Data Engineer IV Location :: 100% Remote Position Type :: Long Term Contract Responsibilities

Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery Lead the design, build, test and deployment of components, collaborating with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) where applicable Understand requirements / use case to outline technical scope and lead delivery of technical solution Confirm required developers and skillsets specific to product Provide leadership, direction, peer review and accountability to developers on the product Work closely with the Product Owner to align on delivery goals and timing Assist Product Owner with prioritizing and managing team backlog Collaborate with Data and Solution architects on key technical decisions, architecture and design to deliver the requirements and functionality Core Experience and Abilities

Power Systems engineering experience DER Dispatch experience Automated fault analysis systems experience Ability to perform hands on development and peer review for certain components / tech stack on the product Standing up development instances and migration path (with required security, access/roles) Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows) Lead implementation of integrated data quality framework Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data) Supports data scientist with test and validation of models Performs impact analysis and identifies risk to design changes Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications Ensures Test Driven development Experience leading teams to deliver complex products Strong technical skills and communication skills Strong skills with business stakeholder interactions Strong solutioning and architecture skills Experience building real time data ingestion streams (event driven) Ensure data security and permissions solutions, including data encryption, user access controls and logging Core Technical Skills

Experience with native AWS technologies for data and analytics such as Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch, etc. Tools and Languages such as Django, Python, Java, Scala, Pandas Infrastructure as Code technology such as Terraform AWS services such as S3, EMR, Glue, Lambda, Athena, Kinesis, EC2, SNS, SQS, CloudWatch Experience with databases such as Redshift, DocumentDB, DynamoDB and MongoDB Experience transitioning on premise big data platforms into cloud-based platforms such as AWS Additional Technical Skills (nice to have)

Hadoop platform (Hive; HBase; Druid) Spark PySpark SQL Workflow Automation DevOps pipeline (CI/CD); Bitbucket; Concourse API frameworks Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees and 70 locations worldwide. As one of the largest IT staffing companies and the 2nd largest minority-owned staffing company in the U.S., Dexian was formed in 2023 through the merger of DISYS and Signature Consultants. Combining the best elements of its core companies, Dexian's platform connects talent, technology, and organizations to produce game-changing results that help everyone achieve their ambitions and goals. Dexian's brands include Dexian DISYS, Dexian Signature Consultants, Dexian Government Solutions, Dexian Talent Development and Dexian IT Solutions. Visit https://dexian.com/ to learn more. Dexian is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

#J-18808-Ljbffr