Amazon
Senior Software Development Engineer , Amazon MSK
Job ID: 3119890 | Amazon Development Center U.S., Inc.
Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team! We are seeking builders for our Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for engineers who are enthusiastic about data streaming, and are as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.
As a member of the Amazon MSK team, you will be making contributions to the entire stack: the APIs and the workflows that make up the MSK service, the core Kafka platform, and stand‑alone tools that make it easier for the Kafka community to operate Kafka better. Upstream compatibility is a core tenet of MSK. Your code changes to the Kafka platform will be released back to open source. You will design and build new features, make performance improvements, identify and investigate new technologies, prototype solutions, build scalable services, and test and review changes to deliver an exceptional customer experience.
The ideal candidate has experience designing large‑scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses analytical, design and problem‑solving skills. Ideally you have an in‑depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open‑source data processing frameworks such as Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large‑scale AWS service, and working with senior leaders to define your team's roadmap, including identifying design and code changes needed in the underlying open‑source platforms.
Learn More About Amazon MSK
AWS re:Invent 2018: Amazon Managed Streaming for Kafka (Amazon MSK) Launch
AWS re:Invent 2020: How Goldman Sachs uses an Amazon MSK backbone for Transaction Banking Platform
AWS re:Invent 2020: How New Relic is migrating its Apache Kafka cluster to Amazon MSK
AWS re:Invent 2021: How Coinbase uses Amazon MSK as an event store for applications
MSK Tiered Storage: Optimize cost and improve Kafka scalability
AWS re:Invent 2023: How Rivian builds real‑time analytics from electric vehicles
Basic Qualifications
5+ years of non‑internship professional software development experience.
5+ years of programming with at least one software programming language.
5+ years of leading design or architecture of new and existing systems (design patterns, reliability and scaling).
Experience as a mentor, tech lead, or leading an engineering team.
Preferred Qualifications
5+ years of full software development life cycle experience (coding standards, code reviews, source control management, build processes, testing, and operations).
Bachelor's degree in computer science or equivalent.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.
This position will remain posted until filled. Applicants should apply via our internal or external career site.
#J-18808-Ljbffr
Come build the future of data streaming with the Amazon Managed Streaming for Kafka (MSK) team! We are seeking builders for our Amazon MSK service, a fully managed service that makes it easy for customers to build and run applications that use Apache Kafka to process streaming data. We are looking for engineers who are enthusiastic about data streaming, and are as passionate about contributing to open source as they are about solving real customers' business needs, at AWS scale.
As a member of the Amazon MSK team, you will be making contributions to the entire stack: the APIs and the workflows that make up the MSK service, the core Kafka platform, and stand‑alone tools that make it easier for the Kafka community to operate Kafka better. Upstream compatibility is a core tenet of MSK. Your code changes to the Kafka platform will be released back to open source. You will design and build new features, make performance improvements, identify and investigate new technologies, prototype solutions, build scalable services, and test and review changes to deliver an exceptional customer experience.
The ideal candidate has experience designing large‑scale systems supporting millions of transactions per second, enjoys solving complex software problems, and possesses analytical, design and problem‑solving skills. Ideally you have an in‑depth understanding of streaming data technologies like Amazon Kinesis or Apache Kafka, and experience with open‑source data processing frameworks such as Apache Spark, Apache Flink, or Apache Storm. Your responsibilities will include collaborating with other engineers to build a large‑scale AWS service, and working with senior leaders to define your team's roadmap, including identifying design and code changes needed in the underlying open‑source platforms.
Learn More About Amazon MSK
AWS re:Invent 2018: Amazon Managed Streaming for Kafka (Amazon MSK) Launch
AWS re:Invent 2020: How Goldman Sachs uses an Amazon MSK backbone for Transaction Banking Platform
AWS re:Invent 2020: How New Relic is migrating its Apache Kafka cluster to Amazon MSK
AWS re:Invent 2021: How Coinbase uses Amazon MSK as an event store for applications
MSK Tiered Storage: Optimize cost and improve Kafka scalability
AWS re:Invent 2023: How Rivian builds real‑time analytics from electric vehicles
Basic Qualifications
5+ years of non‑internship professional software development experience.
5+ years of programming with at least one software programming language.
5+ years of leading design or architecture of new and existing systems (design patterns, reliability and scaling).
Experience as a mentor, tech lead, or leading an engineering team.
Preferred Qualifications
5+ years of full software development life cycle experience (coding standards, code reviews, source control management, build processes, testing, and operations).
Bachelor's degree in computer science or equivalent.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information.
This position will remain posted until filled. Applicants should apply via our internal or external career site.
#J-18808-Ljbffr