Backend Software Engineer, Inference Optimization

at  TikTok

Responsibilities
TikTok will be prioritizing applicants who have a current right to work in Singapore, and do not require TikTok’s sponsorship of a visa.
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok’s global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Creation is the core of TikTok’s purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That’s how we drive impact - for ourselves, our company, and the communities we serve.
Join us.
About the Team
Our Trust and Safety R&D team is fast growing and responsible for building machine learning models and systems to identify and defend internet abuse and fraud on our platform. With the continuous efforts from our team, TikTok is able to provide the best user experience and bring joy to everyone in the world.
Our mission is to build a bridge for collaboration between algorithm models and business scenarios, and efficiently and stably apply TnS’s algorithmic capabilities to TikTok’s business scenarios. And let TnS’s algorithmic capabilities cover wherever TikTok needs them.

Qualification

• Bachelor’s degree in Computer Science, Engineering or equivalent practical experience
• Master at least one of the following languages in Linux environment: C/C++, Python, Go
• Master at least one state-of-the-art machine learning framework (e.g., Tensorflow, Pytorch);
• Strong analytical abilities and problem solvin

Preferred Qualifications

• Familiar with model optimization algorithms like quantization and pruning.
• Practical experience in performance optimization/tuning of deep learning model training/inference.
• Practical experience in CUDA programming and TensorRT
• Familiar with LLM model inference framework like VLLM and TensorRT-LL

1. Work closely with business teams to optimize the integration plan for algorithm applications, improve efficiency in evaluating and using algorithm applications across various business scenarios, and reduce the cost of managing and optimizing algorithm applications in different business scenarios.
2. Be responsible for the architectural design, development, and performance tuning of algorithm applications, solving technical challenges such as high concurrency, high reliability, and high scalability. Work includes multiple sub-areas: resource scheduling, task orchestration, model training, model inference, model management, dataset management, workflow orchestration, etc.
3. Be responsible for researching and introducing cutting-edge engineering technologies related to algorithms.
   Qualifications

Qualification

• Bachelor’s degree in Computer Science, Engineering or equivalent practical experience
• Master at least one of the following languages in Linux environment: C/C++, Python, Go
• Master at least one state-of-the-art machine learning framework (e.g., Tensorflow, Pytorch);
• Strong analytical abilities and problem solving

Preferred Qualifications

• Familiar with model optimization algorithms like quantization and pruning.
• Practical experience in performance optimization/tuning of deep learning model training/inference.
• Practical experience in CUDA programming and TensorRT
• Familiar with LLM model inference framework like VLLM and TensorRT-LLM

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too