As soon as the participant steps onto one of the stages, the system instantly recognizes him and generates a unique avatar that mirrors his movements in real time.
When the unser now opens his mouth, the avatar does the same and begins to sing like an opera singer – no own singing skills required!
The sound can be shaped through simple movements: hand positions control pitch and volume, while mouth shapes influence the vowels (A,E,O).
To find the most intuitive ways to modify sound and to guarantee the best experience, we did several user-testings. The best-rated interactions were included in the final design.
