Role Overview
The TikTok U.S. Data Security (USDS) Data Platform Team builds scalable, reliable, cost-efficient infrastructure that ensures data integrity and empowers business units through self-service tools and scientific insights. We are seeking a Software Engineer to contribute to efficiency, stability, and AI-driven innovation. You will optimize core data engines—Apache Spark, Kafka, ClickHouse, and Doris—and help build AI/ML-powered solutions that enhance platform intelligence, automate operations, and drive cost optimization at petabyte scale.
Responsibilities
- Assist in optimizing Apache Spark performance and resource utilization for large-scale data processing.
- Participate in enhancing ClickHouse and Doris OLAP systems through query tuning and storage-compute optimization.
- Contribute to automated job diagnosis and failure analysis systems using AI/ML techniques.
- Help build and maintain monitoring and self-healing capabilities for data pipelines.
- Support development of robust disaster recovery and data integrity mechanisms.
- Work closely with senior engineers to deliver high-quality, maintainable code and system designs; engage in code reviews and technical documentation.
Requirements
- BS/MS in Computer Science, Engineering, or a related technical field.
- 1+ years of hands-on experience building or maintaining distributed systems.
- Strong proficiency in standard programming languages such as Java, Scala, C++, or Python.
- Solid understanding and practical experience with modern big data technologies (e.g., Apache Spark, ClickHouse, Doris, or similar engines).