Logo
TikTok

Data Ingestion SRE, Data Platform -USDS

TikTok, Seattle, Washington, us, 98127

Save Job

Overview

Site Reliability Engineering (SRE) combines software and systems engineering to build and run large-scale, massively distributed services and infrastructures. As a site reliability engineer in the data platform area, you will have the opportunity to manage the services and infrastructures in one of the largest dataplaforms in the world that directly supports the TikTok app. You'll need to ensure the data, services and infrastructures are reliable, fault-tolerant, efficiently scalable and cost-effective. Responsibilities

End-to-End Service Lifecycle Management: Participate in and continuously improve the full lifecycle of services, from initial design and development to deployment, ongoing operation, and iterative optimization. Ensure Reliability and Scalability: Maintain highly reliable, fault-tolerant, and scalable systems that are both cost-effective and efficient, ensuring data, services, and infrastructure meet business needs. Performance Troubleshooting: Diagnose and resolve performance issues, including slow queries, resource contention, and bottlenecks across distributed storage engines and services. Cluster Scaling and Data Growth: Plan and implement strategies for scaling clusters effectively to accommodate increasing data volume while optimizing performance and cost-efficiency. Documentation and Incident Response: Develop and maintain clear runbooks, Standard Operating Procedures (SOPs), and lead sustainable, blameless incident response practices with post-incident analysis to drive continuous improvement. Big Data System Design: Architect and implement robust, scalable, and extensible big data systems that support the core business and products, ensuring seamless data flow and system integration. On-Call Rotation: Participate in on-call rotations for production incidents, ensuring critical issues are addressed swiftly, with availability to troubleshoot and resolve problems outside of regular business hours as needed. Incident Ownership and Analysis: Take ownership of incidents during on-call hours, coordinate escalations as necessary, and conduct thorough post-incident analyses to identify root causes and implement preventive measures. Qualifications

Minimum Qualifications Bachelor's degree in Computer Science, a related technical field involving software or systems engineering, or equivalent practical experience. Experience writing code in Java, Scala, Go, Python, or a similar language. Strong scripting skills (e.g., Bash and Shell) for automation tasks. Experience with algorithms, data structures, complexity analysis, and software design: Solid understanding of how to build scalable and efficient systems. Basic SQL (MySQL, PostgreSQL, or similar): Strong understanding of traditional relational databases like MySQL or PostgreSQL. Ability to write queries, perform joins, use aggregate functions, and optimize basic SQL queries. Systems and Infrastructure: Knowledge of Linux/Unix systems, as most infrastructure is based on Linux. Familiarity with system internals, networking, and resource management (memory, CPU, storage). Hands-on experience with observability tools such as Prometheus, Grafana, & OpenTSDB: For monitoring, logging, and real-time performance tracking. CI/CD Tools: Familiarity with Continuous Integration/Continuous Deployment pipelines and tools (e.g., Jenkins, GitLab CI). Systematic problem-solving approach, coupled with effective communication skills and a sense of drive. Preferred Qualifications Hands-on experience with distributed processing frameworks like Apache Spark and Apache Flink: Expertise in using these frameworks for large-scale data processing and stream processing. Familiarity with Apache Kafka and Apache Hive integrations: Experience with these tools in the context of data pipelines and stream processing. HiveSQL Knowledge: Solid understanding of HiveSQL (Hive Query Language - HQL), including the ability to write, optimize, and debug queries on large datasets stored in Hadoop-based systems (like Hive, HDFS, or similar). HiveSQL with Kafka Stream Integration: Knowledge and experience in integrating HiveSQL with Kafka Streams or Kafka Connect for real-time data processing Experience running production-grade services at scale: Understanding of cloud-native technologies, networking, and storage management to support high-availability and large-scale environments. Experience developing tools and APIs: To reduce manual intervention in systems administration and improve automation and operational efficiency. Expertise in designing, analyzing, and troubleshooting large-scale systems: Experience with Hadoop, Spark, Hive, Presto, Kafka, Flink, or comparable solutions is a strong plus. Candidates for this position must be legally authorized to work in the United States. This position is not eligible for visa sponsorship or support. About Us

TikTok is the leading destination for short-form mobile video. Our mission is to inspire creativity and bring joy. U.S. Data Security (“USDS”) is a subsidiary of TikTok in the U.S. This new, security-first division was created to bring heightened focus and governance to our data protection policies and content assurance protocols to keep U.S. users safe. Our focus is on providing oversight and protection of the TikTok platform and U.S. user data, so millions of Americans can continue turning to TikTok to learn something new, earn a living, express themselves creatively, or be entertained. The teams within USDS that deliver on this commitment daily span across Trust & Safety, Security & Privacy, Engineering, User & Product Ops, Corporate Functions and more. Data Security Statement: This role requires the ability to work with and support systems designed to protect sensitive data and information. As such, this role will be subject to strict national security-related screening. Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. We strive to do great things with great people, lead with curiosity and humility, and make an impact in a rapidly growing tech company. Join us.

#J-18808-Ljbffr