Mismatch of the head movement (raw video vs. generated video)

[schxnhxlz]

Hey there,

first of all great project! Had a lot fun playing around with it. My next step is to put the generated video back on top of the raw video.

To remain the real eye and forehead movement i want to mask out just the nose mouth and jaw:

Unfortunateley the movement of the raw head and the "new" head doesnt match 100%. There is still a little mismatch. It looks like the head is wobbling.

comp.mp4

I already set the hparams['infer_smooth_camera_path_kernel_size'] = 7 to 0 and isabled the smooth featues

 smo_euler = smooth_features_xd(batch['euler'])
 smo_trans = smooth_features_xd(batch['trans'])

setting drv_pose to static didnt help. Are there any other parameters I can try to edit to achieve a perfect match of the landmarks? Especially for the nose and eyes?

Thanks in advance!

[jryebread]

i have the same problem, hoping someone can answer this!