Class GaussianBlurBackgroundProcessor

The GaussianBlurBackgroundProcessor, when added to a VideoTrack, applies a gaussian blur filter on the background in each video frame and leaves the foreground (person(s)) untouched. Each instance of GaussianBlurBackgroundProcessor should be added to only one VideoTrack at a time to prevent overlapping of image data from multiple VideoTracks.

Example

import { createLocalVideoTrack } from 'twilio-video';
import { GaussianBlurBackgroundProcessor } from '@twilio/video-processors';

let blurBackground: GaussianBlurBackgroundProcessor;

(async() => {
  blurBackground = new GaussianBlurBackgroundProcessor({
    assetsPath: 'https://my-server-path/assets'
  });
  await blurBackground.loadModel();

  const track = await createLocalVideoTrack({
    // Increasing the capture resolution decreases the output FPS
    // especially on browsers that do not support SIMD
    // such as desktop Safari and iOS browsers, or on Chrome
    // with capture resolutions above 640x480 for webgl2.
    width: 640,
    height: 480,

    // Any frame rate above 24 fps on desktop browsers increase CPU
    // usage without noticeable increase in quality.
    frameRate: 24
  });
  track.addProcessor(virtualBackground, {
    inputFrameBufferType: 'videoframe',
    outputFrameBufferContextType: 'bitmaprenderer'
  });
})();
Copy