AI Models
AVCLabs Video Enhance AI is a video enhancement and upscaling software that uses AI modeling to intelligently enhance, upscale, denoise, colorize, and restore the video. It also supports the conversion of footage to higher frame rates and even the creation of smooth slow-motion effects. It also features a world-leading AI Face Enhancement model to detect, recognize, recover and refine faces.
AVCLabs Enhancement AI currently has 5 AI models: AI Enhancement, Face Enhancement, Colorize, Motion Compensation and SDR to HDR.
Additional AI models are currently being trained and will be rolled out as soon.
#1. AI Enhancement
The AI Enhancement model, as the name suggests, is used to improve the quality of old videos and to upscale low-resolution videos to HD, 4K, and 8K resolutions. AI Enhancement model offers users a choice of 6 model options, Standard, Ultra, Anime, Standard (Multi-Frame), Ultra (Multi-Frame), and Denoise, as well as a Detail Balance parameter option.
Standard:
Process video on a frame-by-frame basis at the fastest possible speed. It is the best choice if your computer is not equipped to handle high-end, but you want to get good-quality output.
Ultra:
Process video on a frame-by-frame basis, in Ultra quality (upscale to 4K), but at a 2x slower processing speed than the Standard mode. You can choose this model if your computer has a dedicated graphics card with at least 4GB of GPU memory.
*Note: Ultra model has been upgraded in V4.0.0, resulting in an 80% increase in speed, more refined detail handling, and significantly enhanced effects.
Anime:
This model is specifically used for scaling or cleaning up old animes or cartoons while recovering their lost details and clarity.
Standard (Multi-Frame):
Process video on 13 frames at a time. Multi-Frame models can take advantage of pixel information from adjacent frames, to decrease blurring/ flickers and maintain consistency. The processing time is similar to the Ultra model (maybe a bit slower in some circumstances).
*Note: Please make sure your computer has a dedicated GPU (RTX 2060 and higher) with at least 6GB of GPU memory.
Ultra (Multi-Frame):
Same as the Standard (Multi-Frame) model, process video on 13 frames at a time, but in Ultra quality. The processing time is 3x slower than the Standard (Multi-Frame) model.
*Note: Please make sure your computer has a dedicated GPU (RTX 3060 and higher) with at least 8GB of GPU memory.
The models Standard (Multi-Frame) and Ultra (Multi-Frame) are only available for the Windows version.
Denoise:
Remove noise from videos to improve picture quality. Distractions such as graininess and color fringes in the video are effectively removed, making the video clearer and more detailed.
*Note: The Standard and Ultra models support denoising as well.
Detail Balance:
Adjusts the balance between the original video and AI-enhanced output. Higher values apply more AI enhancement for sharper details, while lower values keep more of the original video for a softer, more natural look.
#2. Face Enhancement
The world-class AI Face Detection, Recognition, and Enhancement model for videos, you can use this model to recover faces from old videos and enhance overall quality.
*Note: Enabling face refinement will take an additional 2 or more seconds (depending on the configuration of your computer) to process each frame. In addition, please make sure that your computer has at least 4 GB of GPU memory.
#3. Colorize
Colorize the black&white videos to make your old videos come to life. Select the appropriate coloring model and adjust the render factor.
Premium:
The Premium model delivers balanced and realistic colors with accurate tones and smooth transitions. It is designed to preserve natural details in areas such as skin tones, landscapes, clothing, and objects.
*Note: To fully utilize the performance of this model, a graphics card with 8GB or more of VRAM is recommended.
Bright:
The Bright model creates more vivid and eye-catching colors by enhancing color intensity and contrast. It is ideal for users who want a more visually impactful and lively result.
Soft:
The Soft model applies subtle colorization while maintaining the original grayscale details and overall mood of the video. It produces softer tones with smooth color transitions for a more natural appearance.
#4. Frame Interpolation & Motion Compensation
Frame Interpolation: Convert the frame rate from low to high to make your video clearer, and smoother, without image ghosting, distortion, and stutter. This deep-learning-based frame interpolation can accurately predict and understand the video’s motion, and naturally re-construct missing background information. It works great for animations, action movies, and fast-moving sports videos.
*Note: The processing performance of frame interpolation AI is directly proportional to the video resolution, the higher the resolution, the longer the time required.
Motion Compensation: An advanced method for motion estimation and interpolation for high quality slow motion effects.
*Note: Enabling the slow motion effect will take a much longer time to process the video. Our R&D is working on performance improvement, and you will see a significant improvement soon.
#5. SDR to HDR
The SDR to HDR Conversion feature automatically enhances standard SDR videos by expanding their dynamic range, improving brightness, contrast, and overall visual details.
When enabled, the AI automatically processes the video to create a more HDR-like viewing experience, with richer details in both bright and dark areas.
SDR Original:
HDR Enhanced:
