[Feature] Add Webcam API #1178

ly015 · 2022-02-11T03:19:34Z

Motivation

Modification

BC-breaking (Optional)

Use cases (Optional)

Checklist

Before PR:

I have read and followed the workflow indicated in the CONTRIBUTING.md to create this PR.
Pre-commit or linting tools indicated in CONTRIBUTING.md are used to fix the potential lint issues.
Bug fixes are covered by unit tests, the case that causes the bug should be added in the unit tests.
New functionalities are covered by complete unit tests. If not, please add more unit tests to ensure correctness.
The documentation has been modified accordingly, including docstring or example tutorials.

After PR:

CLA has been signed and all committers have signed the CLA in this PR.

* refactor node event handler

* Add exiting handler method to nodes * Add VideoEndingMessage

* modify frame rate calculation * rename BillboardNode as NoticeBoardNode

* add README.md * update gif

* add facwswap node * adapt to webcam_api * adapt to webcam_api * move config * add sync mode in runner * fix bugs and update nodes

* add supersaiyan effects * fix init * apply background * update config * apply saiyan effects * rebase * rebase and fix * update doc * update docs * add load image from disk or url * make the resources to url links * mv load_image_from_disk_or_url to utils/misc * move effect funcs to webcam_api * rebase * fix pytest * fix docs * add get_local_path_given_url * add get_local_path_given_url * rename to get_cached_file_path * update readme * update readme

Co-authored-by: zengwang <[email protected]>

* Fix missing flag in `load_image_from_disk_or_url` * Add SpriteNode

* fix mmpose nodes * add dummy video capture * add xdwendwen node

* Update XDwenDwen example * add rigid transform * update configs and readme files * extend meow dwen dwen * update config * support cfg-options

codecov · 2022-02-11T04:11:58Z

Codecov Report

❗ No coverage uploaded for pull request base (dev-0.23@585cc48). Click here to learn what that means.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             dev-0.23    #1178   +/-   ##
===========================================
  Coverage            ?   82.24%           
===========================================
  Files               ?      204           
  Lines               ?    16185           
  Branches            ?     2885           
===========================================
  Hits                ?    13312           
  Misses              ?     2143           
  Partials            ?      730

Flag	Coverage Δ
unittests	`82.18% <0.00%> (?)`

Flags with carried forward coverage won't be shown. Click here to find out more.

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 585cc48...6365e1d. Read the comment docs.

* add cam runner [wip] * update webcam runner and node api * reorganize module structure * add model node * add pose model node [wip] * update message * add monitor node * rename config * refactor webcam util * add update_route_info * add input_check_interval * add fps for one-euro in mmpose node * refactor visualition nodes * fix bug * modify runner argument and fix bug * add doc * add doc * add webcam_runner docstrings * add docstrings * update interface and docstring * add RecorderNode * * add syncrhonous result binding mode * refactor node event handler * fix typing * fix typing (open-mmlab#1082) * * Add RecorderNode for saving video to files * Add exiting handler method to nodes * Add VideoEndingMessage * rename _on_exit ot on_exit * fix typing * Fix a few issues * register node event handler in __init__ * change default pose model to vipnas_mblv3 * Node._on_exit -> Node.on_exit * fix typing * fix typing * change from thread based to process based * solve cuda distributed [wip] * fix process creating method and buffer size * thread based buffer * node based on thread * node set daemon=False as default * fix logging level and add docstrings * modify register_event * * reorganize webcam tool configs * modify frame rate calculation * rename BillboardNode as NoticeBoardNode * [WebcamAPI] Add demo README (open-mmlab#1133) * add README.md * update gif * [WebcamAPI] Add facwswap node and config (open-mmlab#1094) * add facwswap node * adapt to webcam_api * adapt to webcam_api * move config * add sync mode in runner * fix bugs and update nodes * [WebcamAPI] Supersaiyan (open-mmlab#1098) * add supersaiyan effects * fix init * apply background * update config * apply saiyan effects * rebase * rebase and fix * update doc * update docs * add load image from disk or url * make the resources to url links * mv load_image_from_disk_or_url to utils/misc * move effect funcs to webcam_api * rebase * fix pytest * fix docs * add get_local_path_given_url * add get_local_path_given_url * rename to get_cached_file_path * update readme * update readme * fix bug that only one bbox is detected for each class * fix faceswap config * add newyear demo (open-mmlab#1143) Co-authored-by: zengwang <[email protected]> * [Feature] Add a `SpriteNode` for Webcam API (open-mmlab#1160) * Fix missing flag in `load_image_from_disk_or_url` * Add SpriteNode * Meow dwen dwen (open-mmlab#1173) * fix mmpose nodes * add dummy video capture * add xdwendwen node * fix configs * Update README.md * [WebcamAPI] Update XDwenDwen example (open-mmlab#1177) * Update XDwenDwen example * add rigid transform * update configs and readme files * extend meow dwen dwen * update config * support cfg-options * turn-off default help instruction * fix typo Co-authored-by: Jas <[email protected]> Co-authored-by: Lumin <[email protected]> Co-authored-by: zengwang <[email protected]> Co-authored-by: Ma Zerun <[email protected]>

ly015 requested review from jin-s13 and removed request for jin-s13 February 11, 2022 03:19

ly015 changed the base branch from master to dev-0.23 February 11, 2022 03:20

ly015 force-pushed the webcam_api branch from 89ff788 to a8bfda0 Compare February 11, 2022 03:23

ly015 added 26 commits February 11, 2022 11:28

add cam runner [wip]

baa48d8

update webcam runner and node api

2b6c960

reorganize module structure

325e51b

add model node

0add5f1

add pose model node [wip]

4d36f3e

update message

c491504

add monitor node

4e47e8d

rename config

eb0371b

refactor webcam util

2176262

add update_route_info

a5e83b5

add input_check_interval

b690e8a

add fps for one-euro in mmpose node

d6a85b6

refactor visualition nodes

be7f967

fix bug

0c27061

modify runner argument and fix bug

14aa957

add doc

7f9d01f

add doc

44e7bde

add webcam_runner docstrings

3bca940

add docstrings

b0c4714

update interface and docstring

912cbae

add RecorderNode

34ba638

* add syncrhonous result binding mode

3a075d0

* refactor node event handler

fix typing

3797445

fix typing (#1082)

e31ecb5

* Add RecorderNode for saving video to files

2a1be8f

* Add exiting handler method to nodes * Add VideoEndingMessage

rename _on_exit ot on_exit

646369f

ly015 and others added 13 commits February 11, 2022 11:28

modify register_event

5428766

* reorganize webcam tool configs

a916d96

* modify frame rate calculation * rename BillboardNode as NoticeBoardNode

[WebcamAPI] Add demo README (#1133)

9863b9f

* add README.md * update gif

[WebcamAPI] Add facwswap node and config (#1094)

7e71d86

* add facwswap node * adapt to webcam_api * adapt to webcam_api * move config * add sync mode in runner * fix bugs and update nodes

fix bug that only one bbox is detected for each class

706b78f

fix faceswap config

182d194

add newyear demo (#1143)

7a28a3f

Co-authored-by: zengwang <[email protected]>

[Feature] Add a SpriteNode for Webcam API (#1160)

e328b69

* Fix missing flag in `load_image_from_disk_or_url` * Add SpriteNode

Meow dwen dwen (#1173)

311332c

* fix mmpose nodes * add dummy video capture * add xdwendwen node

fix configs

f584d22

Update README.md

5bf09a3

[WebcamAPI] Update XDwenDwen example (#1177)

452ea5b

* Update XDwenDwen example * add rigid transform * update configs and readme files * extend meow dwen dwen * update config * support cfg-options

ly015 force-pushed the webcam_api branch from a8bfda0 to 452ea5b Compare February 11, 2022 03:29

ly015 requested review from jin-s13, zengwang430521, liqikai9, luminxu and wusize February 11, 2022 03:52

ly015 added 2 commits February 11, 2022 14:16

turn-off default help instruction

88772b1

fix typo

6365e1d

ly015 force-pushed the webcam_api branch from afa676d to 6365e1d Compare February 11, 2022 06:20

jin-s13 approved these changes Feb 11, 2022

View reviewed changes

ly015 merged commit fa07051 into dev-0.23 Feb 11, 2022

jin-s13 deleted the webcam_api branch April 27, 2022 09:32

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Feature] Add Webcam API #1178

[Feature] Add Webcam API #1178

ly015 commented Feb 11, 2022

codecov bot commented Feb 11, 2022 •

edited

Loading

[Feature] Add Webcam API #1178

[Feature] Add Webcam API #1178

Conversation

ly015 commented Feb 11, 2022

Motivation

Modification

BC-breaking (Optional)

Use cases (Optional)

Checklist

codecov bot commented Feb 11, 2022 • edited Loading

Codecov Report

codecov bot commented Feb 11, 2022 •

edited

Loading