Adobe's latest experiment follows your body to create super-fast animations

Adobe provides an example of an After Effects R&D function that can automatically track human movements and apply them to animations. The body tracker detects movement of the human body in source videos to generate track points for 18 joints across the arms, trunk and legs, which can then be transferred to the animated character. Similar to how Adobe & # 39; s Character Animator can track facial expressions, the feature could be a quick way to create 2D body animations.


The function can also create a contour mask around the body, which can be used in various ways, such as sorting video colors and highlighting the foreground. It can also be used to easily create an outline around a topic that you want to remove with content-aware stuffing that automatically fills in a selection based on the environment. The function is also useful for adding moving images or other objects to the tracked body. For example, if you want to animate a scene in which the characters play basketball, you can ensure that the basketball remains at the character's hand.

The feature uses the artificial intelligence platform Sensei from Adobe, which was trained on more than 10,000 images to manually identify the body points, said Adobe research scientist Jimei Yang during a demo. "I can easily link the tracking points to the corresponding controllers on my character so that the keyframes can be transferred," Yang said.

Body tracker is not meant to replace the animation process, but to manually reduce keyframing and save time. It can be seen as a powerful additional tool, just like third-party plug-ins Diving Bassel, a free animation tool for characters that automatically builds human structures and runs gait cycles. "We hope [animators will] be happy with the results as an early starting point, to save a lot of time on their end product," says Yang.

The feature is shown at Adobe's annual Max design conference during the Sneaks keynote, where experimental lab features are shown. Although not all Sneaks functions achieve the end product, earlier functions shown on Sneaks such as Content-Aware Fill have, hopefully the Body Tracker will soon reach the After Effects.