Olaf Hering (olh)
accepted
request 5840
about 1 year ago
(revision 1)
272 commits
Files
Type
Name
Latest commit message
Commit time
.github
Update build-project.yaml (#421)
last month
build-aux
Fix links on build-aux (#395)
2 months ago
cmake
C17 is only supported CMake 3.21+ (#430)
last month
data
Fix blur background halo effect (#415)
last month
docs
BUILDING-FEDORA.md: add curl-devel (#439)
last week
src
Generate static libraries for HttpClient (#433)
3 weeks ago
.clang-format
Update our build system with obs-plugintemplate (#357)
3 months ago
.cmake-format.json
Update our build system with obs-plugintemplate (#357)
3 months ago
.gitignore
Don't exclude the docs directory (#402)
2 months ago
.python-version
new demo gif
6 months ago
CMakeLists.txt
Remove libcurl from Mac and Windows (#420)
last month
CMakePresets.json
Use system curl on Linux by default (#399)
2 months ago
LICENSE
Change license to GPLv2 (#201)
6 months ago
README.md
Update README.md
last month
buildspec.json
bump v1.1.6
last week
demo.gif
update demo gif
3 months ago
README.md
OBS Plugin: Portrait Background Removal / Virtual Green-screen and Low-Light Enhancement
GitHub GitHub Workflow Status Total downloads Flathub GitHub release (latest by date)
A plugin for OBS Studio that allows you to replace the background in portrait images and video, as well as enhance low-light scenes.
Introduction
Building
MacOSX
Linux (Ubuntu, Arch, openSUSE)
Windows
Other plugins from us:
🚧 Experimental 🚧: CleanStream OBS plugin for real-time filler word (uh,um) and profanity removal from live audio stream
✨ NEW: URL/API Source a plugin for live fetching of API data and displaying on screen as a video source
✨ NEW: LocalVocal speech AI assistant plugin for real-time local transcription (captions), translation and other language functions
Download
Check out the latest releases for downloads and install instructions.
Linux Installation
On Ubuntu, there are two ways to install OBS and you have to use the corresponding method to install this plugin.
If you installed OBS via the official PPA, download the deb package from the releases page and install it directly.
If you installed OBS via FlatHub, run the following command: flatpak install com.obsproject.Studio.Plugin.BackgroundRemoval
The pre-built binary of this plugin can run Ubuntu 22.04 or later.
On openSUSE, please see docs/BUILDING-OPENSUSE.md.
On other Linux distros, use the FlatHub installation of both OBS and this plugin. If you install OBS in a way other than FlatHub, you have to build this plugin by yourself (see instructions for building below).
Code Walkthrough
This video on YouTube will take you through the major parts of the code and explain them.
OBS Version Support and Compatibility
OBS version 29+ (download) for the latest version of this plugin, e.g. 1.1.x and above.
OBS version 28+ for this plugin's version between 0.5.x and 1.0.x.
OBS version 27+ for this plugin's version 0.4.x and below.
Introduction
This plugin is meant to make it easy to replace the background in portrait images and video. It is using a neural network to predict the mask of the portrait and remove the background pixels. It's easily composable with other OBS plugins to replace the background with e.g. an image or a transparent color.
If you like this work, which is given to you completely free of charge, please consider supporting it by sponsoring us on GitHub:
https://github.com/sponsors/royshil
https://github.com/sponsors/umireon
OBS Plugins forum: https://obsproject.com/forum/resources/background-removal-portrait-segmentation.1260/
Tutorial video on YouTube: https://youtu.be/veqNEsMqEE0
OBS.Background.Removal.Plugin.Tutorial-veqNEsMqEE0.mp4
GPU support:
Currently on Windows we support DirectML, which should reduce CPU usage by 95% and effectively use the systems accelerators (GPUs if available).
On Mac we support CoreML for acceleration, which is available on M1 and M2 (not Intel, sorry).
CUDA is supported in this plugin through TensorRT, however it is supported only on Linux.
The goal of this plugin is to be available for everyone on every system, even if they don't own a GPU.
Number of CPU threads is controllable through the UI settings. A 2-thread setting works best.
The pretrained model weights used for portrait foreground segmentation are taken from:
https://github.com/anilsathyan7/Portrait-Segmentation/tree/master/SINet
https://github.com/PaddlePaddle/PaddleSeg/tree/release/2.7/contrib/PP-HumanSeg
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/082_MediaPipe_Meet_Segmentation
https://github.com/PeterL1n/RobustVideoMatting
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/384_TCMonoDepth and https://github.com/yu-li/TCMonoDepth
Image enhancement (low light) models are taken from:
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/213_TBEFN
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/372_URetinex-Net
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/370_Semantic-Guided-Low-Light-Image-Enhancement
https://github.com/PINTO0309/PINTO_model_zoo/tree/main/243_Zero-DCE-improved
Some more information about how I built it: https://www.morethantechnical.com/2021/04/15/obs-plugin-for-portrait-background-removal-with-onnx-sinet-model/ and https://www.morethantechnical.com/2023/05/20/building-an-obs-background-removal-plugin-a-walkthrough/
Building
The plugin was built and tested on Mac OSX (Intel & Apple silicon), Windows and several Linux disros (e.g. Ubuntu/Debian-ish, Fedora, and more). Help is appreciated in building on other OSs and packages.
The building pipelines in CI take care of the heavy lifting. Use them in order to build the plugin locally. We attempt to use external OpenCV, libcurl and ONNX Runtime to reduce build times.
Start by cloning this repo to a directory of your choice.
Mac OSX
Using the CI pipeline scripts, locally you would just call the zsh script. By default this builds a universal binary for both Intel and Apple Silicon. To build for a specific architecture please see .github/scripts/.build.zsh for the -arch options.
$ ./.github/scripts/build-macos -c Release
Install
The above script should succeed and the plugin files (e.g. obs-backgroundremoval.plugin) will reside in the ./release/Release folder off of the root. Copy the .plugin file to the OBS directory e.g. ~/Library/Application Support/obs-studio/plugins.
To get .pkg installer file, run for example
$ ./.github/scripts/package-macos -c Release
(Note that maybe the outputs will be in the Release folder and not the install folder like pakage-macos expects, so you will need to rename the folder from build_x86_64/Release to build_x86_64/install)
Linux
Ubuntu
Use the CI scripts again
$ ./.github/scripts/build-linux.sh
Arch Linux
The community maintains AUR packages: https://aur.archlinux.org/packages/obs-backgroundremoval
Fedora
To compile on Fedora, you need to manage the dependencies manually. See docs/BUILDING-FEDORA.md for more information.
FlatHub
The plugin is available on FlatHub: https://github.com/flathub/com.obsproject.Studio.Plugin.BackgroundRemoval
$ flatpak install com.obsproject.Studio.Plugin.BackgroundRemoval
Windows
Use the CI scripts again, for example:
> .github/scripts/Build-Windows.ps1 -Target x64 -CMakeGenerator "Visual Studio 17 2022"
The build should exist in the ./release folder off the root. You can manually install the files in the OBS directory.
Star History Chart
About
An OBS plugin for removing background in portrait images (video), making it easy to replace the background when recording or streaming.