Home App - Mobile Virtual Reality FB Researchers Develop Systems to Make Avatars Play Musical Instruments

FB Researchers Develop Systems to Make Avatars Play Musical Instruments

37
0




Published by ,
January 1, 1:29 pm



(CNBC)  Facebook artificial researchers have come up with a novel way to make cartoonish avatars look like they’re really playing instruments. The work could lead to fascinating augmented reality or virtual reality experiences in the future.
Facebook research scientists Eli Shlizerman and Ira Kemelmacher-Shlizerman and collaborators Lucio Dery and Hayden Schoen talk trained systems using YouTube videos of piano and violin recitals. They then used the trained systems to make avatars move their hands and fingers with fake instruments based solely on audio recordings, with the help of Apple’s ARKit AR software for developers.

Tags: , ,



Source link

LEAVE A REPLY

Please enter your comment!
Please enter your name here