Skip to content

ROI-based encoding with CBR/CQP mode #892

@taste1981

Description

@taste1981

A typical video conferencing app may perform video segmentation and apply background replacement or blur, then encode.

If the segmentation mask can be delivered to WebCodecs as the input for ROI-based encoding, encoder can apply improved QP to regions that is not masked, while consuming less bits on masked regions.

For use cases that background image is not user-self-uploaded image, or the background is blurred, delivering the mask end-to-end with such kind of encoding, will help to reduce bandwidth, while not having visual quality impact.

For sending masks in-band, MPEG annotated-region SEI could be an option.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions