Compunnel
We are hiring a Cybersecurity Senior Data Engineer to support the development of a robust and scalable cybersecurity data mesh. This role involves building data pipelines, integrating cybersecurity tools, and ensuring seamless ingestion, transformation, and retrieval of data.
Key Responsibilities:
Develop and maintain data pipelines for ingesting cybersecurity data from 200+ source tools such as CrowdStrike, Zscaler, and PingID
Implement ETL/ELT processes to prepare data for analysis in the data mesh/lake
Optimize and monitor real-time and batch data processing workflows
Ensure data quality, consistency, and compliance with organizational standards
Collaborate with architects and SMEs to align pipelines with cybersecurity use cases and governance frameworks
Implement data security measures, including encryption, RBAC, and masking, to protect sensitive data
Troubleshoot and resolve issues in data pipelines and systems integration
Required Qualifications:
5+ years of experience in data engineering, with a focus on cybersecurity or enterprise data
Strong expertise in building data pipelines using tools like Apache Spark, Kafka, and Azure Data Factory
Hands-on experience with cloud data platforms (Azure preferred)
Proficiency in programming languages such as Python, Java, or Scala
Familiarity with cybersecurity tools and data standards
Knowledge of compliance frameworks (GDPR, CCPA, SOX) is a plus
Strong problem-solving and debugging skills
#J-18808-Ljbffr