Commits

Breadcrumbs

History for

ontransform-request-function

User selector

All users

All time

Commit History

Commits on Jan 27, 2025

• Update docs/introduction/code/03_transform_request.py

  Show description for d102c70
  

  Mantisus

  and

  janbuchar

  authored
  d102c70

  Copy full SHA for d102c70

Commits on Jan 23, 2025

• type update

  Mantisus

  committed
  dd9c364

  Copy full SHA for dd9c364

• Update docs/introduction/03_adding_more_urls.mdx

  Show description for acebe56
  

  Mantisus

  and

  vdusek

  authored
  acebe56

  Copy full SHA for acebe56

• rresolve

  Mantisus

  committed
  a82edca

  Copy full SHA for a82edca

• feat: add `block_requests` helper for `PlaywrightCrawler` (#919)

  Show description for 1030459
  

  Mantisus

  and

  vdusek

  authored
  1030459

  Copy full SHA for 1030459

Commits on Jan 22, 2025

• add return with Literal

  Mantisus

  committed
  4fbbb7d

  Copy full SHA for 4fbbb7d

• feat: Add keep_alive flag to `crawler.__init__` (#921)

  Show description for 7a82d0c
  Pijukatel

  authored
  7a82d0c

  Copy full SHA for 7a82d0c

Commits on Jan 21, 2025

• change transform_request_function for works with RequestOptions

  Mantisus

  committed
  d1cbd9b

  Copy full SHA for d1cbd9b

Commits on Jan 20, 2025

• update doc

  Mantisus

  committed
  063f7db

  Copy full SHA for 063f7db

• feat: add `transform_request_function` for `enqueue_links`

  Mantisus

  committed
  48fd4c2

  Copy full SHA for 48fd4c2

• docs: fix typo (#920)

  Show description for 5a7158e
  Mantisus

  authored
  5a7158e

  Copy full SHA for 5a7158e

Commits on Jan 17, 2025

• docs: add guide for PlaywrightCrawler and BrowserPool (#916)

  Show description for cfd5dda
  

  Mantisus

  and

  vdusek

  authored
  cfd5dda

  Copy full SHA for cfd5dda

• docs: Fix Playwright + Camoufox code example (#915)

  Show description for 5fc027a
  vdusek

  authored
  5fc027a

  Copy full SHA for 5fc027a

Commits on Jan 16, 2025

• docs: Update API docs of public components (#914)

  Show description for 3886b73
  vdusek

  authored
  3886b73

  Copy full SHA for 3886b73

• docs: Fix code sample on home page (#913)

  Show description for 6940af4
  vdusek

  authored
  6940af4

  Copy full SHA for 6940af4

Commits on Jan 15, 2025

• docs: update request loaders & storages guide (#904)

  vdusek

  authored
  dea6ca3

  Copy full SHA for dea6ca3

Commits on Jan 10, 2025

• docs: Add Storages & Request loaders guides (#896)

  Show description for 5d689f6
  vdusek

  authored
  5d689f6

  Copy full SHA for 5d689f6

Commits on Jan 6, 2025

• docs: add session management guide (#795)

  Show description for beac9fa
  

  Mantisus

  and

  vdusek

  authored
  beac9fa

  Copy full SHA for beac9fa

Commits on Jan 2, 2025

• chore: Fix new dir structure-related issues (#854)

  vdusek

  authored
  9a0725b

  Copy full SHA for 9a0725b

Commits on Dec 20, 2024

• refactor!: Update the crawlers & storage clients structure (#828)

  Show description for 0ba04d1
  vdusek

  authored
  0ba04d1

  Copy full SHA for 0ba04d1

• refactor!: Rename PlaywrightCrawler kwargs: browser_options, page_options (#831)

  Show description for ffc6048
  

  Pijukatel

  and

  vdusek

  authored
  ffc6048

  Copy full SHA for ffc6048

Commits on Dec 19, 2024

• feat!: Implement `RequestManagerTandem`, remove `add_request` from `RequestList`, accept any iterable in `RequestList` constructor (#777)

  Show description for 4172652
  

  janbuchar

  and

  vdusek

  authored
  4172652

  Copy full SHA for 4172652

• refactor!: Rename PwPreNavContext to PwPreNavCrawlingContext (#827)

  Show description for 84b61a3
  vdusek

  authored
  84b61a3

  Copy full SHA for 84b61a3

Commits on Dec 18, 2024

• feat: Add stop method to BasicCrawler (#807)

  Show description for 6d01af4
  

  Pijukatel

  and

  vdusek

  authored
  6d01af4

  Copy full SHA for 6d01af4

Commits on Dec 16, 2024

• refactor!: remove `json_` and `order_no` from `Request` (#788)

  Show description for 5381d13
  

  Mantisus

  and

  janbuchar

  authored
  5381d13

  Copy full SHA for 5381d13

Commits on Dec 13, 2024

• fix!: Refactor service usage to rely on `service_locator` (#691)

  Show description for 1d31c6c
  vdusek

  authored
  1d31c6c

  Copy full SHA for 1d31c6c

Commits on Dec 12, 2024

• feat: Add example of how to integrate Camoufox into PlaywrightCrawler (#789)

  Show description for 246cfc4
  Pijukatel

  authored
  246cfc4

  Copy full SHA for 246cfc4

• feat: Add pre-navigation hooks router to AbstractHttpCrawler (#791)

  Show description for 0f23205
  

  Pijukatel

  and

  janbuchar

  authored
  0f23205

  Copy full SHA for 0f23205

Commits on Dec 10, 2024

• docs: Update upgrading guide for renamed BeautifulSoupParser (#799)

  Show description for 13bb400
  Pijukatel

  authored
  13bb400

  Copy full SHA for 13bb400

• feat: Add possibility to use None as no proxy in tiered proxies (#760)

  Show description for 0fbd017
  Pijukatel

  authored
  0fbd017

  Copy full SHA for 0fbd017

Commits on Dec 6, 2024

• refactor!: Refactor HttpCrawler, BeautifulSoupCrawler, ParselCrawler inheritance (#746)

  Show description for 9d3c269
  

  3 peopleauthored
  9d3c269

  Copy full SHA for 9d3c269

Commits on Nov 27, 2024

• docs: Move code snippets to separate files (#752)

  Show description for 7925740
  vdusek

  authored
  7925740

  Copy full SHA for 7925740

Commits on Nov 25, 2024

• docs: fix code snippets in "Deploy to Apify" guide (#741)

  Show description for d979ab5
  Mantisus

  authored
  d979ab5

  Copy full SHA for d979ab5

Commits on Nov 12, 2024

• fix: Fix serialization payload in Request. Fix Docs for Post Request (#683)

  Show description for e8b4d2d
  

  Mantisus

  and

  vdusek

  authored
  e8b4d2d

  Copy full SHA for e8b4d2d

Commits on Nov 6, 2024

• docs: update example file names to fix type checking (#657)

  vdusek

  authored
  d0a4787

  Copy full SHA for d0a4787