Skip to content

feat: add first version of browser pool and playwright crawler#161

Merged
vdusek merged 30 commits intomasterfrom
add-browser-pool
May 29, 2024
Merged

feat: add first version of browser pool and playwright crawler#161
vdusek merged 30 commits intomasterfrom
add-browser-pool

Conversation

@vdusek
Copy link
Copy Markdown
Collaborator

@vdusek vdusek commented May 25, 2024

Description

  • Introduce the initial version of BrowserPool and PlaywrightCrawler.
  • It lacks several features - fingerprinting, hooks, managing multiple instances of browsers, browser abstraction, ...
  • BrowserPool is responsible for managing browser-related resources, but currently, it only supports handling a single browser instance through the plugin.
  • Also a very first version of PlaywrightCrawler is introduced, primarily to enhance testing and to provide a clear view of the end-user interface and results.

Related issues

Testing

  • Unit tests for new modules were written.
  • For ad-hoc test code samples see README.md.

TODO

  • playwright install in CI
  • update related issues

@github-actions github-actions bot added this to the 90th sprint - Tooling team milestone May 25, 2024
@github-actions github-actions bot added t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics. labels May 25, 2024
Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Pull Request Tookit has failed!

Pull request is neither linked to an issue or epic nor labeled as adhoc!

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Pull Request Tookit has failed!

Pull request is neither linked to an issue or epic nor labeled as adhoc!

Copy link
Copy Markdown
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Pull Request Tookit has failed!

Pull request is neither linked to an issue or epic nor labeled as adhoc!

@vdusek vdusek requested a review from janbuchar May 27, 2024 12:15
@vdusek vdusek marked this pull request as ready for review May 27, 2024 12:16
@vdusek vdusek requested a review from janbuchar May 28, 2024 16:58
@vdusek vdusek requested a review from janbuchar May 29, 2024 10:29
@vdusek vdusek merged commit 2d2a050 into master May 29, 2024
@vdusek vdusek deleted the add-browser-pool branch May 29, 2024 14:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

t-tooling Issues with this label are in the ownership of the tooling team. tested Temporary label used only programatically for some analytics.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants