Nexus Cognitive
Join to apply for the
Data Engineering Manager
role at
Nexus Cognitive . The Data Engineering Manager will lead distributed teams responsible for designing, modernizing, and operating large-scale data pipelines on the NexusOne platform — an open-source-based data and AI control plane for regulated enterprise environments. This leader combines hands-on technical depth with strategic delivery management, ensuring that complex data workloads are refactored, migrated, and optimized using modern, composable frameworks. The role requires strong architectural intuition, proven leadership, and fluency in modern data-engineering technologies.
Responsibilities
Lead distributed data engineering teams to design, modernize, and operate large-scale data pipelines on NexusOne.
Guide architecture and implementation of open-source data stack components and data governance practices.
Drive migration and modernization programs with a focus on performance, reliability, and cost efficiency.
Partner with stakeholders to translate executive vision into technical execution and measurable outcomes.
Foster a culture of delivery excellence in Agile/DevOps settings.
Core Skills & Qualifications
Distributed Data Systems: Apache Spark (core, SQL, streaming) and Airflow orchestration.
Open-Source Data Stack: Iceberg, Trino/Presto, Hive, NiFi, Kafka.
Data Modeling & Transformation: SQL, DBT, and schema-on-read design principles.
Programming & Scripting: Python, Scala, and Java for data pipelines.
Infrastructure & Automation: Kubernetes, Terraform, Helm, GitLab CI/Jenkins, Linux-based environments.
Governance & Security: Ranger, DataHub, RBAC, and enterprise IAM/SSO integration.
Data Quality & Testing: Great Expectations or similar validation frameworks.
Delivery Leadership: Experience managing distributed engineering teams in Agile/DevOps settings.
Ideal Background
8–12 years in data engineering or platform modernization, including 3+ years leading technical teams.
Strong foundation in open-source and hybrid-cloud data ecosystems.
Demonstrated success leading migration or modernization programs at enterprise scale.
Excellent communication and stakeholder-management skills; capable of bridging executive vision and technical execution.
Success Criteria
Delivery of high-performing, production-ready data pipelines on the NexusOne platform.
Adherence to governance, quality, and performance SLAs.
Adoption of standardized frameworks and automation across engineering teams.
Measurable improvement in pipeline reliability, cost efficiency, and developer productivity.
High engagement, retention, and growth within the data-engineering team.
Requirements
Must-Have Core Skills: Distributed Data Systems, Open-Source Data Stack, Data Modeling & Transformation, Programming & Scripting, Infrastructure & Automation, Governance & Security, Data Quality & Testing, Delivery Leadership.
Seniority level: Mid-Senior level Employment type: Full-time Job function: Engineering and Information Technology Industries: IT Services and IT Consulting
Note: Referrals increase your chances of interviewing at Nexus Cognitive.
#J-18808-Ljbffr
Data Engineering Manager
role at
Nexus Cognitive . The Data Engineering Manager will lead distributed teams responsible for designing, modernizing, and operating large-scale data pipelines on the NexusOne platform — an open-source-based data and AI control plane for regulated enterprise environments. This leader combines hands-on technical depth with strategic delivery management, ensuring that complex data workloads are refactored, migrated, and optimized using modern, composable frameworks. The role requires strong architectural intuition, proven leadership, and fluency in modern data-engineering technologies.
Responsibilities
Lead distributed data engineering teams to design, modernize, and operate large-scale data pipelines on NexusOne.
Guide architecture and implementation of open-source data stack components and data governance practices.
Drive migration and modernization programs with a focus on performance, reliability, and cost efficiency.
Partner with stakeholders to translate executive vision into technical execution and measurable outcomes.
Foster a culture of delivery excellence in Agile/DevOps settings.
Core Skills & Qualifications
Distributed Data Systems: Apache Spark (core, SQL, streaming) and Airflow orchestration.
Open-Source Data Stack: Iceberg, Trino/Presto, Hive, NiFi, Kafka.
Data Modeling & Transformation: SQL, DBT, and schema-on-read design principles.
Programming & Scripting: Python, Scala, and Java for data pipelines.
Infrastructure & Automation: Kubernetes, Terraform, Helm, GitLab CI/Jenkins, Linux-based environments.
Governance & Security: Ranger, DataHub, RBAC, and enterprise IAM/SSO integration.
Data Quality & Testing: Great Expectations or similar validation frameworks.
Delivery Leadership: Experience managing distributed engineering teams in Agile/DevOps settings.
Ideal Background
8–12 years in data engineering or platform modernization, including 3+ years leading technical teams.
Strong foundation in open-source and hybrid-cloud data ecosystems.
Demonstrated success leading migration or modernization programs at enterprise scale.
Excellent communication and stakeholder-management skills; capable of bridging executive vision and technical execution.
Success Criteria
Delivery of high-performing, production-ready data pipelines on the NexusOne platform.
Adherence to governance, quality, and performance SLAs.
Adoption of standardized frameworks and automation across engineering teams.
Measurable improvement in pipeline reliability, cost efficiency, and developer productivity.
High engagement, retention, and growth within the data-engineering team.
Requirements
Must-Have Core Skills: Distributed Data Systems, Open-Source Data Stack, Data Modeling & Transformation, Programming & Scripting, Infrastructure & Automation, Governance & Security, Data Quality & Testing, Delivery Leadership.
Seniority level: Mid-Senior level Employment type: Full-time Job function: Engineering and Information Technology Industries: IT Services and IT Consulting
Note: Referrals increase your chances of interviewing at Nexus Cognitive.
#J-18808-Ljbffr