WATCH: NVIDIA develops AI for reconstructing, editing photos

/ 06:29 PM April 25, 2018

Image: YouTube/NVIDIA

NVIDIA researchers created an artificial intelligence-powered system for reconstructing damaged photos and cleaning up cluttered ones.

The process is called “image inpainting,” which can be implemented on top of photo editing software to enhance the finished product. Missing or removed elements of an image get filled in by computer-generated alternatives, according to a statement.


For example, if a bridge was removed from a picture, the software tries its best to replace the blank space with something similar to the background. This can also be done manually by a skilled artist, but it will take a longer time.

Existing AI-based inpainting methods leave behind noticeable traces on the edited parts of an image. These can be inaccurate colors or blurriness. The researchers overcame this by using a method they call “partial convolution.” The method essentially does another pass-on edited portions of an image and renormalizes them to look as clean as possible.


For their AI, the researchers trained it through deep learning. They generated 55,116 random streaks and holes of arbitrary shapes for the AI to categorize and learn from. The AI then learns to generate and fill in missing pixels on a picture based on the dataset presented to it.

Check out the sample video below to see how the AI fills in the gap after a researcher erases a portion of the image.

The researchers claim the AI system can also be applied in enlarging images while retaining details. This means users won’t see large squares, which represented pixels from the previous smaller resolution.  /ra


Gmail preparing to roll out interface overhaul

WATCH: Google builds AI-powered AR microscope for faster cancer detection

Web browsers to do away with users’ passwords


TOPICS: Artificial Intelligence, deep learning, image editing, image inpainting, NVIDIA
Read Next
Don't miss out on the latest news and information.
View comments

Subscribe to INQUIRER PLUS to get access to The Philippine Daily Inquirer & other 70+ titles, share up to 5 gadgets, listen to the news, download as early as 4am & share articles on social media. Call 896 6000.

For feedback, complaints, or inquiries, contact us.

© Copyright 1997-2020 INQUIRER.net | All Rights Reserved

We use cookies to ensure you get the best experience on our website. By continuing, you are agreeing to our use of cookies. To find out more, please click this link.