Thesis Description & Objectives
Context:
To enhance the effectiveness of driver monitoring systems and in-cabin monitoring technologies, a robust framework is being developed to generate unique virtual scenarios. This framework utilizes realistic digital human models and is currently being implemented in collaboration with a car manufacturer to create a comprehensive database of scenarios for testing dual-camera in-cabin monitoring systems.
Description:
This thesis will focus on enhancing the scenario generation processes within the framework. The candidate will work on improving libraries recall, plugin integration, and rendering techniques. Additionally, the project will involve collecting an animation database and post-processing for animation library generation. New plugins will be developed, to handle easily hand positioning, face and eye gaze animations and the lighting source fuzzing. The project will also enhance scenario fuzzing techniques and develop for the client a ready-to-use
scenario database with related annotations.
Objectives:
1. Enhance Scenario Generation Processes: Improve the efficiency and effectiveness of actual scenario generation process through libraries generation and plugin integration.
2. Animation Database Collection: Collect and post-process animations to create a comprehensive animation library for use in scenario generation (through the usage of wearable suite and other motion capture techniques)
3. Driver Animation Database: Improve an existing dataset for driver animations to enhance DMS capabilities, focusing on realistic responses and behaviors.
4. GenAI fine-tuning: Fine tune a GenAI model to generate driver animations from text inputs.
5. Plugin Development: Create new plugins, including:
• Hand Positioning Animation Manager
• Face and Eye Gaze Animation Manager
• Lighting Source Fuzzing Manager
• Animation Database Interface
6. Scenario Fuzzing Techniques: Enhance existing scenario fuzzing techniques to improve and guarantee variability within the operational design domain
7. Scenario Database Development: Develop a ready-to-use scenario database along with comprehensive annotations for effective testing and validation.
