EXAMINING PARKINSON’S SYMPTOMS IS LABOR-INTENSIVE AND CONSTRAINED BY A SHORTAGE OF NEUROLOGISTS IN UNDERSERVED REGIONS. IN THIS THESIS, YOU WILL GENERATE SYNTHETIC TRAINING DATA BY TRANSFORMING LOW-POLY 3D MODELS OF HANDS AND FEET INTO PHOTOREALISTIC IMAGES WITH LABELED KEY POINTS. USING TECHNIQUES LIKE PIX2PIX GANS, YOU’LL EXPLORE AND OPTIMIZE THE PROCESS TO CREATE A DIVERSE AND ENRICHED DATASET, ENHANCING POSE ESTIMATION MODELS FOR AI-DRIVEN PARKINSON’S SYMPTOM ANALYSIS.

Areas of Interest: Generative AI, Controllable Image Generation, Few-shot Learning
This master’s thesis is part of the graduation project ‘Ontzorg de zorg, zorg voor jezelf!’. This project gives the healthcare sector a digital boost through automation and data analysis, allowing caregivers to spend more time with patients while enabling patients to take control of their personal health data.
The examination of Parkinson’s symptoms is highly labor-intensive, as it requires multiple trained neurologists to thoroughly analyze hand and leg movements. A group of hospitals aims to extend Parkinson’s treatment in the Netherlands to regions where such care is currently unavailable due to a shortage of trained neurologists. To achieve this, they want to make a pre-selection through the help of AI on a smartphone. Part of the solution is a pose estimation model to track hand and foot movements. However, the current dataset for training the model is neither large nor diverse enough. The goal is to enrich the dataset with highly varied data while minimizing the need for manual effort.
Important features for detecting hands and feet could be better balanced by enriching the training dataset with synthetic data. To prevent manual labeling of the training data, it would be ideal if the ground truth for tracking key points is synthesized along with the training images. By converting low-poly 3D models with key point rigs into photorealistic images, a synthetic dataset of labeled training images could be generated. Your task will be to investigate how to transform low-poly models into photorealistic images using AI.

Please refer the Job description for details