Cover image via
In this video tutorial, learn the basics of the brand new Content-Aware Fill in After Effects — including a free project file!
Adobe set the internet ablaze with the announcement of the new Content-Aware Fill feature in the latest After Effects CC release. Now, let’s see if this new feature lives up to the hype. (Spoiler alert: Yes, it does.) In this tutorial, we’re going to cover how to use the new Content-Aware Fill feature in After Effects CC.
In the last movie we talked about all the magical things that you can dowith Content-Aware Fill.In this one I want to talk about what to do when it doesn't work.If you recall, we had this image that was a panorama and we filled in themissing areas, but if you look closely, there is this one particular area thatisn't quite blended right and fixing this is very easy.All we need. Guys, Content Aware Fill in AE is GAME CHANGER. Posted by 1 year ago. Guys, Content Aware Fill in AE is GAME CHANGER. This thread is archived. New comments cannot be posted and votes cannot be cast.
Formerly known as Project Cloak, the AE content-aware fill only requires a rough roto of the items that you want to remove. The user only needs to set up a garbage mask and not a detailed roto of the item to be removed.
So, let’s get started! (Be sure to download the project file, which includes footage to follow along!)
Download the project file
This project file is free for personal or commercial use. By downloading, you agree not to redistribute this file.
What Is Content-Aware Fill?
Content-Aware Fill in After Effects lets you remove unwanted areas or objects in video footage, while automatically filling in the area of the removal. It analyzes frames over time to fill in missing pixels by pulling them from other frames in the footage. It’s similar to the Content-Aware Fill in Photoshop, except in After Effects, it’s temporally aware, and it works on video footage.
How to Start Using Content-Aware Fill
To begin using Content-Aware Fill in After Effects, navigate to the Window tab at the top of the screen, then select Content-Aware Fill. This will open up the Content-Aware Fill panel in your workspace. You will then need to mask out the object you want to remove from your footage. (You may need to keyframe the placement of your mask if your object is moving throughout.) Set the mask to Subtract so that you now have a transparent alpha channel where that mask is on your footage. You should be able to see a mini-preview of where that mask is on your footage in the Content-Aware Fill panel.
You can now select Generate Fill Layer in the Content-Aware Fill panel. After Effects will then analyze the footage and render a .PNG sequence, which it places in the composition. That .PNG sequence fills in the masks/gaps in the footage.
If everything worked correctly, the unwanted objects should no longer be in your footage.
Different Fill Methods
There are three different fill methods you can select from when you use Content-Aware Fill. They are named Object, Surface, and Edge Blend. The Object Fill method will likely be the most commonly used, and it is the default fill method.
- Object Fill: Great for removing moving objects in your footage.
- Surface: Ideal for removing stickers, decals, or logos on a smooth surface.
- Edge Blend: Fast method, best used on low-detail surfaces like paper.
Creating a Reference Frame
In some cases, when Content-Aware Fill isn’t giving you the results you want, you may have better luck using a Reference Frame. (I find this ideal when removing static objects from footage, such as a cell tower or a parked car.) When you select Create Reference Frame, After Effects automatically exports a frame from your video to Photoshop. You can then use the Clone-Stamp tool to fill in the removed area. Then save and close the image in Photoshop.
That reference image will automatically import back into After Effects and into your composition. Content-Aware Fill will now take that reference image into account when it generates the fill throughout the video.
Extra Tips
From my experience with Content-Aware Fill, it seems to work best on objects moving through your footage. This allows After Effects to “see” what the video should look like when the object isn’t supposed to be there. When removing static objects in the scene, results will vary. I recommend using the Create Reference Frame option in those cases. Also, I got the best results when I put a small amount of feathering on my removal masks. It doesn’t take much — usually about 2-8 pixels of feathering.
Interested in the tracks we used to make this video?
- “Retro Vibes” by Wolves
- “Don’t Forget” by Marc Walloch
Looking for more video tutorials? Check these out.
Quickly do a rig or object removal in your video using this content aware fill script.
Did you know you can leverage Photoshop’s powerful content aware tool to intelligently remove objects out of your video frame? The gang over at MotionBoutique.com has released a script that can quickly make objects in your video image disappear.
Adobe Photoshop Content Aware Fill
To use the content aware fill feature on your video you’ll have to first open up your clip in AfterEffects as an image sequence and run a motion tracker on the footage. AE will generate a script that you can run in Photoshop to take advantage of that app’s very useful content aware fill feature.
Photoshop processes the video image and attempts to determine what the image would have looked like if the object removed wasn’t in the original shot. It then uses this data to intelligently fill in the removed area of the image. See the video example from MotionBoutique:
There are other apps and plugins designed for high-end motion tracking and rig removal (see: Mocha) but this is an interesting alternative for users already accustomed to working in Photoshop. Although not too complicated to execute, being a seasoned Photoshop and AE user is beneficial to running through this process.
Content Aware Fill Edges
Download the content aware fill script (free!) from MotionBoutique, as well as instructions on how to execute it.
Tip off from LesterBanks.com who first reported this cool script!