Macpower Digital Assets Edge
Messaging (Kafka) Engineer - Hybrid
Macpower Digital Assets Edge, Jersey City, New Jersey, United States, 07390
Messaging (Kafka) Engineer
Key Responsibilities:
• Design and implement scalable, secure, and high-throughput messaging solutions using Confluent Kafka, Google Pub/Sub Lite, and Azure Service Bus.
• Develop and maintain Kafka topics, schemas, producers, and consumers to support real-time data pipelines and event-driven architectures.
• Collaborate with engineering, DevOps, and product teams to integrate messaging systems into cloud-native microservices and blockchain-based platforms.
• Ensure message durability, ordering, and replayability for financial transactions, including those related to corporate actions and collateral lifecycle events.
• Monitor and tune messaging infrastructure for performance, reliability, and compliance with regulatory requirements.
• Contribute to the development of internal standards and best practices for messaging and data streaming across hybrid cloud environments.
Technical skills: • 5+ years of experience in distributed systems engineering with a focus on messaging and event streaming. • Deep expertise in Confluent Kafka (including Schema Registry, Connect, and KSQL), with hands-on experience in production environments. • Experience with Google Pub/Sub Lite and Azure Service Bus, including hybrid integration patterns. • Proficiency in Java, Python, or Scala for building Kafka clients and stream processors. Familiarity with Kubernetes, Terraform, and CI/CD pipelines for infrastructure automation
Technical skills: • 5+ years of experience in distributed systems engineering with a focus on messaging and event streaming. • Deep expertise in Confluent Kafka (including Schema Registry, Connect, and KSQL), with hands-on experience in production environments. • Experience with Google Pub/Sub Lite and Azure Service Bus, including hybrid integration patterns. • Proficiency in Java, Python, or Scala for building Kafka clients and stream processors. Familiarity with Kubernetes, Terraform, and CI/CD pipelines for infrastructure automation