Research Engineer, Experimentation & Evaluation

at  TikTok

Responsibilities
TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok’s global headquarters are in Los Angeles and Singapore, and its offices include New York, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.
Why Join Us
Creation is the core of TikTok’s purpose. Our platform is built to help imaginations thrive. This is doubly true of the teams that make TikTok possible.
Together, we inspire creativity and bring joy - a mission we all believe in and aim towards achieving every day.
To us, every challenge, no matter how difficult, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always.
At TikTok, we create together and grow together. That’s how we drive impact - for ourselves, our company, and the communities we serve.
Join us.
Our mission in the experimentation and evaluation team is to build the next-gen A/B testing platform, that empowers the company to make data-driven decisions for the products. The supported scenarios include recommendations, push, ads, search, mobile app, UI interaction and service upgrades etc.
Our platform’s capabilities cover the entire experiment life cycle, from experiment design, experiment creation, metrics calculation, and statistical analysis to final evaluation and launch. In the process of rapid iteration, we provide reliable services for businesses to make bold hypotheses and cautious verification.

Position Responsibilities

• Analytics: Work independently to define, design, prototype, and implement complex exploratory analysis, w.r.t both theoretical and business perspectives.
• Methodology development: Leverage deep statistical expertise to improve and/or create methodologies
• Teamwork: Participate actively and thoughtfully in multidisciplinary teams to implement algorithms in production
• Communication: Effectively communicate insights and recommendations to support decisions on future research directions
• Mentorship: Oversee the analyses of junior statisticians and data scientists, and support their professional development

Qualifications

Minimum Qualification

• M.S. or Ph.D. in Statistics, Econometrics, Operations Research, Mathematics, Computer Science, or other quantitative fields
• Passion for solving unstructured and non-standard mathematical problems
• Expertise in experimental design and/or Bayesian inference & optimization
• Fluency with SQL or similar
• Proficiency with Python, or other interpreted programming languages like R or Matlab

Preferred Qualification

• Experience with Bayesian experiment/optimization system design
• Experience with quasi-experimental causal inference (Rubin causal model/ structural causal model/ instrumental variables etc.)
• In-depth understanding and hands-on experience in wielding tools like graphs.
• Experience with applying modern machine learning techniques and/or collaborating with ML scientists
• Excellent written and oral communication skills, including an ability to translate statistical methods and findings for a non-technical audience
• Comfortable with massive paper searching, reading and composing.

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://shorturl.at/cdpT2
Job Information
The base salary range for this position in the selected city is $164160 - $416100 annually.
​
Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.
​
Our company benefits are designed to convey company culture and values, to create an efficient and inspiring work environment, and to support our employees to give their best in both work and life. We offer the following benefits to eligible employees:
​
We cover 100% premium coverage for employee medical insurance, approximately 75% premium coverage for dependents and offer a Health Savings Account(HSA) with a company match. As well as Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life and AD&D insurance plans. In addition to Flexible Spending Account(FSA) Options like Health Care, Limited Purpose and Dependent Care.
​
Our time off and leave plans are: 10 paid holidays per year plus 17 days of Paid Personal Time Off (PPTO) (prorated upon hire and increased by tenure) and 10 paid sick days per year as well as 12 weeks of paid Parental leave and 8 weeks of paid Supplemental Disability.
​
We also provide generous benefits like mental and emotional health benefits through our EAP and Lyra. A 401K company match, gym and cellphone service reimbursements. The Company reserves the right to modify or change these benefits programs at any time, with or without notice

• Analytics: Work independently to define, design, prototype, and implement complex exploratory analysis, w.r.t both theoretical and business perspectives.
• Methodology development: Leverage deep statistical expertise to improve and/or create methodologies
• Teamwork: Participate actively and thoughtfully in multidisciplinary teams to implement algorithms in production
• Communication: Effectively communicate insights and recommendations to support decisions on future research directions
• Mentorship: Oversee the analyses of junior statisticians and data scientists, and support their professional developmen