Use handy tools
These models provide utility functions for working with media like images, audio, and video. They serve as convenient building blocks for media processing pipelines and workflows.
Key capabilities:
- Background removal - Remove backgrounds from images and videos
- Content moderation - Detect NSFW images
- Audio visualization - Convert audio clips to animated waveforms
- Video editing - Extract frames, add captions, remove background, make cuts via transcript
- Format conversion - Convert between images, frames, video and GIFs
Our Pick: cjwbw/rembg
For most people, we recommend the cjwbw/rembg model for removing backgrounds from images. It’s blazing fast, easy to use, and produces great results. With over 1.4 million runs, it’s battle-tested and very popular.
Also Great: lucataco/nsfw_image_detection
If you need to moderate image content, lucataco/nsfw_image_detection is an excellent choice. This fine-tuned vision transformer classifies images as safe-for-work or not-safe-for-work. It’s widely used with over 1.1 million runs.
Noteworthy
A few other models to consider for common media processing tasks:
- fofr/audio-to-waveform - Visualize audio as an animated waveform video
- fofr/controlnet-preprocessors - Prepare ControlNet inputs like canny edges, depth, segmentation, etc.
- fofr/video-to-frames and fofr/frames-to-video - Convert between video and frames
- fofr/toolkit - Swiss army knife for quick video edits
- jd7h/edit-video-by-editing-text - Make cuts to video by editing the transcript
Recommended models
cjwbw/rembg
Remove images background
lucataco/nsfw_image_detection
Falcons.ai Fine-Tuned Vision Transformer (ViT) for NSFW Image Classification
fofr/audio-to-waveform
Create a waveform video from audio
arielreplicate/robust_video_matting
extract foreground of a video
fofr/controlnet-preprocessors
Canny, soft edge, depth, lineart, segmentation, pose, etc
charlesmccarthy/addwatermark
Add a watermark to your videos using the power of Replicate brought to you from your friends at FullJourney.AI
smoretalk/rembg-enhance
A background removal model enhanced with ViTMatte.
fofr/video-to-frames
Split a video into frames
fictions-ai/autocaption
Automatically add captions to a video
camenduru/bria-rmbg
Remove background from images using BRIA-RMBG-1.4
fofr/toolkit
Video toolkit – convert, make GIFs, extract audio
nateraw/video-background-remover
Turn the background of a video into a green screen 🎥🖼
fofr/frames-to-video
Convert a set of frames to a video
lucataco/img-and-audio2video
Take an image and an audio file and create a video clip
chigozienri/image-urls-to-video
Take a list of image URLs as frames and output a video
lucataco/deep3d
Deep3D: Real-Time end-to-end 2D-to-3D Video Conversion, based on deep learning
jd7h/edit-video-by-editing-text
A pipeline for superfast video editing! Make cuts to a video by editing its transcript.
lucataco/depth-anything-video
Depth Anything on full video files