Adobe provides an example of a number of experimental functions that could ever come into its apps, including several that use AI to manipulate images and audio.
The features were unveiled last night at Adobe's Sneaks event at the company's annual Max Creativity Conference, and this year the features made intensive use of Adobe's Sensei AI platform. Sneaks is where apps like Adobe Fresco and features such as content-aware stuffing were first viewed, so there is a good chance that some of these tools will appear in a Creative Cloud app near you in the future.
Comedian John Mulaney organized the event this year and served as a guinea pig for Adobe researchers to demonstrate the new features. Among the experiments was a feature called Go Figure, which automatically follows the movement of a person and can translate into quick animations. Watch the videos below to see which functions are worth looking forward to and which functions you should shrink in fear of the growing power of AI. You can also read the Adobe blog for a complete list of functions.
Somewhere along the way to add powerful new AI functions that can open paths for misinformation, Adobe realizes its own role and responsibility for managing these functions. About Face analyzes the pixels of an image and shows a heat map whose images have been edited. The probability is then revealed that the image may have been manipulated. The tool is currently being developed to focus on the manipulation of faces, hence the name.
All In is for those moments when you take a group photo, but still want to be part of the photo. With this feature, you can take two photos – one where you sit behind the camera and one where you are in the photo – and use Sensei to join the two together to get you in the frame.
Coordinating the dialogue with the lip movements of animated characters is usually a difficult process. With Sweet Talk you can identify character faces in photos & paintings and adjust their facial expressions and mouth movements to an audio file.
Sound Seek can identify repetitive sounds such as "ums" and "uhs" from a person's speech and remove all unwanted fill words with just one click.
Awesome Audio is a feature of Adobe Audition, the company's audio editing app, which is supposed to remove annoying ambient sounds and make amateur recordings sound like they were made with a professional microphone. It can also remove excessive reverb and echo, reduce degradation and clean up audio with one click.