Rhythm Based Motion-Music Matching Model

This paper presents a rhythm based motion-music correlation model for motion choreographing and music dubbing in computer animation.The model measures motion-music matching quality by applying dynamic time warping(DTW)algorithm on the extracted rhythm features of motion and music sequences.The overall motion-music matching pipeline is decomposed into two phases:pre-computation and real-time matching.During pre-computation phase,the motion-music correlation model calculates the matching quality of all possible motion-music pairs in database and constructs a motion-music mapping graph.During real-time matching phase,we locate the best-fit motion or music sequences from the mapping graph,then optimize the matching quality by fine-tuning the positions of rhythm feature points inside the candidate motion or music sequences.The experimental results indicate that our model can effectively generate desirable motion or music sequences well matched to input data.