Diversity-Promoting Human Motion Interpolation via Conditional Variational Auto-Encoder

Chunzhi Gu, Shuofeng Zhao, Chao Zhang*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper, we present a deep generative model based method to generate diverse human motion interpolation results. We resort to the Conditional Variational Auto-Encoder (CVAE) to learn human motion conditioned on a pair of given start and end motions, by leveraging the Recurrent Neural Network (RNN) structure for both the encoder and the decoder. Additionally, we introduce a regularization loss to further promote sample diversity. Once trained, our method is able to generate multiple plausible coherent motions by repetitively sampling from the learned latent space. Experiments on the publicly available dataset demonstrate the effectiveness of our method, in terms of sample plausibility and diversity.

Original languageEnglish
Title of host publicationInternational Workshop on Advanced Imaging Technology, IWAIT 2022
EditorsMasayuki Nakajima, Shogo Muramatsu, Jae-Gon Kim, Jing-Ming Guo, Qian Kemao
PublisherSPIE
ISBN (Electronic)9781510653313
DOIs
StatePublished - 2022
Event2022 International Workshop on Advanced Imaging Technology, IWAIT 2022 - Hong Kong, China
Duration: 2022/01/042022/01/06

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume12177
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference2022 International Workshop on Advanced Imaging Technology, IWAIT 2022
Country/TerritoryChina
CityHong Kong
Period2022/01/042022/01/06

Keywords

  • Conditional Variational Auto-Encoder
  • Diverse human motion interpolation

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Diversity-Promoting Human Motion Interpolation via Conditional Variational Auto-Encoder'. Together they form a unique fingerprint.

Cite this