salesforce.com, inc.
Staff Software Engineer, Data Engineering
salesforce.com, inc., Seattle, Washington, us, 98127
Overview
Slack is looking for a staff software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Data Warehouse with both streaming and batch approaches. Currently, our infrastructure handles 180PB+ of storage, processes ~1T records a day, 400+ data pipelines and 1000+ Active Airflow DAGs. As Slack's data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies. As a Staff Engineer, you will play a key role in driving our streaming and lakehouse strategies while also building highly scalable services and tools to help our customers acquire large volumes of high quality data at scale and making customers' interactions with the ingested data pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack! What you will be doing
Design and develop highly scalable and resilient streaming and batch services for ingesting and processing structured and unstructured datasets Design and implement Slack's Lakehouse solutions and enable production use cases for customers Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration) Improve the data quality and reliability of the pipelines through proper monitoring and alerting Collaborate with cross functional partners and lead technical initiatives end to end Coach and mentor other engineers across the org Write, review, or provide feedback on a technical design proposal from others What you should have
7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies (e.g., Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent) Experience building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, etc. Proficiency in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent Experience building robust distributed microservices with Kubernetes, Docker, AWS ECS/EKS, Terraform, etc. Strong focus on code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests Excellent written and verbal communication and interpersonal skills; able to collaborate with cross functional partners and explain sophisticated technical concepts to non-technical stakeholders High growth mindset and willingness to push yourself and your team to achieve goals Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience Slack has a positive, diverse, and supportive culture—we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative. Unleash Your Potential When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future - but to redefine what's possible - for yourself, for AI, and the world. Accommodations
If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form. Posting Statement
Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. Recruiting, hiring, and promotion decisions are fair and based on merit, without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. In the United States, compensation offered will be determined by factors such as location, job level, knowledge, skills, and experience. Salesforce offers a variety of benefits to help you live well, including time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and employee stock purchase program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com. Salesforce will consider for employment qualified applicants with arrest and conviction records for certain roles. For Washington-based roles, the base salary range is $211,500 to $306,600. For California-based roles, the base salary range is $230,800 to $334,600.
#J-18808-Ljbffr
Slack is looking for a staff software engineer to join the Data Ingestion Team. As part of the Data Engineering organization, we build and operate the platform that ingests data from various sources into our Data Warehouse with both streaming and batch approaches. Currently, our infrastructure handles 180PB+ of storage, processes ~1T records a day, 400+ data pipelines and 1000+ Active Airflow DAGs. As Slack's data grows (along with the number of customers, features and employees), the goal of the team is to build a highly scalable and resilient ingestion platform leveraging modern Streaming and Lakehouse technologies. As a Staff Engineer, you will play a key role in driving our streaming and lakehouse strategies while also building highly scalable services and tools to help our customers acquire large volumes of high quality data at scale and making customers' interactions with the ingested data pleasant and productive. You will have deep technical skills, be a self-starter, detail and quality oriented, and passionate about driving data driven decisions and having a huge impact at Slack! What you will be doing
Design and develop highly scalable and resilient streaming and batch services for ingesting and processing structured and unstructured datasets Design and implement Slack's Lakehouse solutions and enable production use cases for customers Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration) Improve the data quality and reliability of the pipelines through proper monitoring and alerting Collaborate with cross functional partners and lead technical initiatives end to end Coach and mentor other engineers across the org Write, review, or provide feedback on a technical design proposal from others What you should have
7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies (e.g., Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent) Experience building and maintaining batch data pipelines using Spark, Airflow, EMR, S3, etc. Proficiency in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent Experience building robust distributed microservices with Kubernetes, Docker, AWS ECS/EKS, Terraform, etc. Strong focus on code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests Excellent written and verbal communication and interpersonal skills; able to collaborate with cross functional partners and explain sophisticated technical concepts to non-technical stakeholders High growth mindset and willingness to push yourself and your team to achieve goals Bachelor's degree in Computer Science, Engineering or related field, or equivalent training, fellowship, or work experience Slack has a positive, diverse, and supportive culture—we look for people who are curious, inventive, and work to be a little better every single day. In our work together we seek to be smart, humble, hardworking and, above all, collaborative. Unleash Your Potential When you join Salesforce, you'll be limitless in all areas of your life. Our benefits and resources support you to find balance and be your best, and our AI agents accelerate your impact so you can do your best. Together, we'll bring the power of Agentforce to organizations of all sizes and deliver amazing experiences that customers love. Apply today to not only shape the future - but to redefine what's possible - for yourself, for AI, and the world. Accommodations
If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form. Posting Statement
Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. Recruiting, hiring, and promotion decisions are fair and based on merit, without regard to race, religion, color, national origin, sex, sexual orientation, gender identity, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. In the United States, compensation offered will be determined by factors such as location, job level, knowledge, skills, and experience. Salesforce offers a variety of benefits to help you live well, including time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and employee stock purchase program. More details about company benefits can be found at the following link: https://www.salesforcebenefits.com. Salesforce will consider for employment qualified applicants with arrest and conviction records for certain roles. For Washington-based roles, the base salary range is $211,500 to $306,600. For California-based roles, the base salary range is $230,800 to $334,600.
#J-18808-Ljbffr