Skip to content

Add support for custom selectors for extracting links #2152

Open
@tw4l

Description

Related to webrecorder/browsertrix-crawler#217

We now have the ability in the crawler to specify custom selectors for extracting links, but this has not yet been added to the workflow editor UI.

In sprint planning we also briefly discussed whether we could have a sort of catch-all way of adding crawler flags that don't have corresponding Browsertrix UI elements like this - possibly a text box where users could add arbitrary flags (this would require a good deal of thought and might have security implications).

Tasks

  • Wireframes
  • Backend: Allow users to manage custom selectors per workflow via API
  • Frontend: Configure custom selectors per workflow

Metadata

Assignees

Labels

back endRequires back end dev workfront endRequires front end dev work

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions