Artanim is a non-profit foundation founded in 2011 and located in Geneva, Switzerland. The foundation carries out research activities in the field of computer graphics according to two strategic axes of research linked to motion capture: virtual reality, mainly the creation and animation of digital avatars and the development of interactive VR and AR applications; and medical research (joint biomechanics, orthopaedics, sports medicine).
The lab has a long-term expertise in various motion capture technologies, including high-end optical systems, as well as inertial and markerless motion tracking devices. More generally, one focus of research of Artanim is to conceive innovative interactive VR/AR applications using human motion as a medium or controller to derive user immersive experience.
ROLE IN THE PROJECT
Artanim has two main roles in the project. First, it will provide a complete Unity3D application with a set of tools to modify virtual CAD content, as well as to annotate the experience along the way. The second task is to develop a suitable markerless motion capture solution based on multiple RGB cameras with the aid of Machine Learning algorithms.
The University of Applied Sciences and Arts of Southern Switzerland (SUPSI) is one of the 7 Universities of Applied Sciences of Switzerland. It has a university statute and focuses on professional training and applied research. The main mission of SUPSI is the promotion of technological development and technological transfer. SUPSI is involved with the Institute of Information Systems and Networking (ISIN), one of the five institutes of SUPSI’s Department of Innovative Technologies (DTI). ISIN carries out teaching and research activities in the information and communication technology domain.
Within ISIN, two research laboratories are involved in the project:
- The Complex Networks and Pervasive Computing lab: the lab main competences cover the study of complex systems, network science, emotion recognition, personalization and profiling, pervasive and ubiquitous computing.
- The Audio-Visual processing and Immersive Multimedia lab: the main competences of the team are in mobile multiplayer digital games based on distributed cloud-based software infrastructures, immersive environments and computer graphics technologies for VR/AR, GPUs and DSPs, audio, image, and video processing.
ROLE IN THE PROJECT
SUPSI has two main roles in the project. First, it will provide a toolset to export CAD designs to a format suitable for interactive VR experiences, while maintaining references to the original data, as well as enabling the import of user-modified and annotated data back into the CAD realm. Secondly, it will develop a HAR module which will analyze real-time mocap data for human emotions, leading to the implicit annotation of CAD designs.