Apples New Method Creates Animatable 3D Avatar from Video

▤ Summary

HUGS takes a monocular video with a small (50-100) number of frames so that the algorithm learns to disentangle the static scene and a fully animatable human avatar in 30 minutes. "We utilize the SMPL body model to initialize the human Gaussians. To capture details that are not modeled by SMPL (e.g., cloth, hairs), we allow the 3D Gaussians to deviate from the human body model. Utilizing 3D Gaussians for animated humans brings new challenges, including the artifacts created when articulating the Gaussians."

▦ Linked Companies