top of page

PeCap W2 '24: Brows and Eyes in Faceware Analyzer

Writer: Hannah ChungHannah Chung

Updated: Aug 1, 2024

This week we went over how to setup and start training our sequence in Analyzer.

I started by importing my face cam sequence and then aligned the marker template to the face markers to create the neutral frame.

With the neutral frame set up as best as I could percieve (the inner lips were a little challenging), I started adding key frames for the eyebrows.

The keyframes I chose were the first frame after neutral (1), when the brows were furthest down (403) and up (63) plus the best brow squeeze example I could see (267). With these 5 keyframes I was able to train the system to identify the pixels where I've set the markers, and from this information the program can then track their location over the sequence duration using the track button.


Luckily, it did a pretty great job of tracking with just those 5 keyframes. However, there were some patches where the system lost its mark a little and the markers 'flew off'. For example, from Frame 69 the brows were essentially floating along the face for couple frames.

So by setting up another keyframe on frame 69 and retraining/tracking, the system can gather more information and create a more accurate result.

The inner most marker on the right eyebrow is quite bouncy still but as a first attempt the majority of the movement has been tracked well.

After the brows, I moved onto the eyes. I only used 7 frames for the eyes including the pose after neutral (1), eyes open and furthest left (65) and right (268), eyes open centre (85), eyes closed/blinking (406) and eyes open, looking up (558). I was fortunate there were no moments where the markers flew off so the only extra marker I added was on frame 196 when I moved only the pupil markers.

Now that the eyes and brows have been completed we'll move on to the mouth next week.

Comments


Powered and secured by Wix

ART - DESIGN - BLOG - PORTFOLIO

bottom of page