Zignal Labs
Join to apply for the
Senior Data Engineer
role at
Zignal Labs . Get AI-powered advice on this job and more exclusive features. About Zignal Labs Zignal Labs’ real-time intelligence technology helps the world’s largest organizations protect their people, places, and position. Analyzing billions of data points in real time, Zignal's AI-powered platform accelerates mission-critical decision making by empowering leaders with contextual situational awareness of the information environment. Fully remote, with Silicon Valley roots and team members in over 20 states, Zignal serves customers around the world. Learn more at zignallabs.com. About The Role
As a Senior Data Engineer at Zignal Labs, you’ll design and build a distributed data and analytics infrastructure using open-source technologies like Apache Spark, Apache Storm, and Elasticsearch. We process data from social media, news, blogs, and other media sources to empower users with real-time insights. In This Role, You Will
Build and maintain scalable, high-performance data pipelines for large-scale data ingestion, real-time analytics, and ML services Develop and optimize distributed systems that support downstream NLP, LLMs, and other AI-powered applications Design and implement reliable, maintainable backend services and microservices Write scalable, testable code and follow modern engineering practices (e.g., version control, CI/CD, code reviews) Collaborate with product, QA, and operations teams to co-develop and deliver technical solutions that meet user needs What We're Looking For
Proficiency in Scala, Java, and Python for backend development and data engineering Experience with Apache Spark (and Spark Streaming) and platforms like Databricks or Delta Lake Practical experience working with AWS services (e.g., Lambda, EC2, API Gateway) Experience with real-time data streaming frameworks like Apache Storm, Kafka, or Pekko Familiarity with search technologies such as Elasticsearch Experience with NoSQL databases (e.g., MongoDB, Redis), and relational databases (e.g., RDS) Exposure to workflow orchestration tools like Apache NiFi is a plus Experience with cloud-native deployments, CI/CD pipelines, and DevOps best practices Strong understanding of computer science fundamentals, such as algorithms, data structures, and system design Experience in database query optimization and performance tuning To Be Successful In This Role, You Will Need
A bachelor’s degree (or higher) in Computer Science, Engineering, or a related field, or equivalent practical experience At least 5 years of professional experience building scalable data pipelines with Apache Spark or Databricks, or equivalent experience with Apache Storm Strong communication and collaboration skills, and the ability to work effectively during U.S. time zones Proficiency in Java or Scala, with a willingness to work in Scala Experience with Python is a plus Referrals increase your chances of interviewing at Zignal Labs by 2x Get notified about new Senior Data Engineer jobs in
San Francisco, CA .
#J-18808-Ljbffr
Senior Data Engineer
role at
Zignal Labs . Get AI-powered advice on this job and more exclusive features. About Zignal Labs Zignal Labs’ real-time intelligence technology helps the world’s largest organizations protect their people, places, and position. Analyzing billions of data points in real time, Zignal's AI-powered platform accelerates mission-critical decision making by empowering leaders with contextual situational awareness of the information environment. Fully remote, with Silicon Valley roots and team members in over 20 states, Zignal serves customers around the world. Learn more at zignallabs.com. About The Role
As a Senior Data Engineer at Zignal Labs, you’ll design and build a distributed data and analytics infrastructure using open-source technologies like Apache Spark, Apache Storm, and Elasticsearch. We process data from social media, news, blogs, and other media sources to empower users with real-time insights. In This Role, You Will
Build and maintain scalable, high-performance data pipelines for large-scale data ingestion, real-time analytics, and ML services Develop and optimize distributed systems that support downstream NLP, LLMs, and other AI-powered applications Design and implement reliable, maintainable backend services and microservices Write scalable, testable code and follow modern engineering practices (e.g., version control, CI/CD, code reviews) Collaborate with product, QA, and operations teams to co-develop and deliver technical solutions that meet user needs What We're Looking For
Proficiency in Scala, Java, and Python for backend development and data engineering Experience with Apache Spark (and Spark Streaming) and platforms like Databricks or Delta Lake Practical experience working with AWS services (e.g., Lambda, EC2, API Gateway) Experience with real-time data streaming frameworks like Apache Storm, Kafka, or Pekko Familiarity with search technologies such as Elasticsearch Experience with NoSQL databases (e.g., MongoDB, Redis), and relational databases (e.g., RDS) Exposure to workflow orchestration tools like Apache NiFi is a plus Experience with cloud-native deployments, CI/CD pipelines, and DevOps best practices Strong understanding of computer science fundamentals, such as algorithms, data structures, and system design Experience in database query optimization and performance tuning To Be Successful In This Role, You Will Need
A bachelor’s degree (or higher) in Computer Science, Engineering, or a related field, or equivalent practical experience At least 5 years of professional experience building scalable data pipelines with Apache Spark or Databricks, or equivalent experience with Apache Storm Strong communication and collaboration skills, and the ability to work effectively during U.S. time zones Proficiency in Java or Scala, with a willingness to work in Scala Experience with Python is a plus Referrals increase your chances of interviewing at Zignal Labs by 2x Get notified about new Senior Data Engineer jobs in
San Francisco, CA .
#J-18808-Ljbffr