Commits

Breadcrumbs

History for

onfix-sql-queue

User selector

All users

All time

Commit History

Commits on Oct 15, 2025

• fix `reclaim_request` in `SqlRequestQueueClient` to correctly update the request state

  Mantisus

  committed
  2a538e8

  Copy full SHA for 2a538e8

Commits on Oct 8, 2025

• chore: Skip flaky Windows test test_crawler_instrumentor_capability (#1470)

  Show description for 39f4db0
  vdusek

  authored
  39f4db0

  Copy full SHA for 39f4db0

Commits on Oct 7, 2025

• chore: Skip flaky Windows test test_gz_sitemap_with_non_gzipped (#1463)

  vdusek

  authored
  5581ed6

  Copy full SHA for 5581ed6

• fix: Add storages name validation (#1457)

  Show description for 84de11a
  Mantisus

  authored
  84de11a

  Copy full SHA for 84de11a

Commits on Oct 1, 2025

• chore: Resolve some warnings in tests (#1442)

  Show description for a23ce8b
  vdusek

  authored
  a23ce8b

  Copy full SHA for a23ce8b

• fix: Fix memory leak in `PlaywrightCrawler` on browser context creation (#1446)

  Show description for bb181e5
  Pijukatel

  authored
  bb181e5

  Copy full SHA for bb181e5

Commits on Sep 29, 2025

• chore: Prevent request manager change after crawler restart (#1432)

  Show description for 002b3f8
  Pijukatel

  authored
  002b3f8

  Copy full SHA for 002b3f8

Commits on Sep 26, 2025

• feat: Add `SqlStorageClient` based on `sqlalchemy` v2+ (#1339)

  Show description for 07c75a0
  

  7 peopleauthored
  07c75a0

  Copy full SHA for 07c75a0

• refactor: Add util function for checking kwarg count (#1423)

  Show description for 58e6a86
  Pijukatel

  authored
  58e6a86

  Copy full SHA for 58e6a86

Commits on Sep 25, 2025

• fix: Set default desired concurrency for non-browser crawlers to 10 (#1419)

  Show description for 1cc9401
  vdusek

  authored
  1cc9401

  Copy full SHA for 1cc9401

Commits on Sep 22, 2025

• feat: Add RQ id, name, alias args to `add_requests` and `enqueue_links` methods (#1413)

  Show description for 1cae2bc
  Mantisus

  authored
  1cae2bc

  Copy full SHA for 1cae2bc

Commits on Sep 19, 2025

• fix: Save `RequestQueueState` for `FileSystemRequestQueueClient` in default KVS (#1411)

  Show description for 6ee60a0
  Mantisus

  authored
  6ee60a0

  Copy full SHA for 6ee60a0

Commits on Sep 17, 2025

• chore: Allow opening pre-existing unnamed storage (#1414)

  Show description for 8f33393
  Pijukatel

  authored
  8f33393

  Copy full SHA for 8f33393

Commits on Sep 16, 2025

• refactor!: Refactor storage creation and caching, configuration and services (#1386)

  Show description for 04649bd
  

  Pijukatel

  and

  vdusek

  authored
  04649bd

  Copy full SHA for 04649bd

Commits on Sep 12, 2025

• feat: Add support for NDU storages (#1401)

  Show description for 5dbd212
  vdusek

  authored
  5dbd212

  Copy full SHA for 5dbd212

Commits on Sep 11, 2025

• chore(deps): update dependency ruff to ~=0.13.0 (#1404)

  Show description for 9843350
  

  renovate[bot]

  and

  vdusek

  authored
  9843350

  Copy full SHA for 9843350

Commits on Aug 29, 2025

• feat: Persist the `SitemapRequestLoader` state (#1347)

  Show description for 27ef9ad
  Mantisus

  authored
  27ef9ad

  Copy full SHA for 27ef9ad

Commits on Aug 28, 2025

• chore: Fix accidentally missing name of the test (#1380)

  Show description for 13f56a2
  Pijukatel

  authored
  13f56a2

  Copy full SHA for 13f56a2

Commits on Aug 25, 2025

• chore: Further reduce retry error summary in log (#1370)

  Show description for 80b5fa8
  Pijukatel

  authored
  80b5fa8

  Copy full SHA for 80b5fa8

Commits on Aug 21, 2025

• refactor!: Remove `Request.id` field (#1366)

  Show description for 32f3580
  

  Pijukatel

  and

  vdusek

  authored
  32f3580

  Copy full SHA for 32f3580

Commits on Aug 19, 2025

• fix: Improve crawler statistics logging (#1364)

  Show description for 1eb6da5
  vdusek

  authored
  1eb6da5

  Copy full SHA for 1eb6da5

• chore: Remove sortedcollections and sortedcontainers packages (#1362)

  Show description for f332408
  vdusek

  authored
  f332408

  Copy full SHA for f332408

Commits on Aug 12, 2025

• feat: Persist `DefaultRenderingTypePredictor` state (#1340)

  Show description for fad4c25
  Mantisus

  authored
  fad4c25

  Copy full SHA for fad4c25

Commits on Jul 30, 2025

• fix: Ignore unknown parameters passed in cookies (#1336)

  Show description for 50d3ef7
  Mantisus

  authored
  50d3ef7

  Copy full SHA for 50d3ef7

Commits on Jul 29, 2025

• fix: Fix retry count to not count the original request (#1328)

  Show description for 74fa1d9
  Pijukatel

  authored
  74fa1d9

  Copy full SHA for 74fa1d9

• fix: Fix memory estimation not working on MacOS (#1330)

  Show description for ab020eb
  Pijukatel

  authored
  ab020eb

  Copy full SHA for ab020eb

Commits on Jul 25, 2025

• refactor!: Replace `HttpxHttpClient` with `ImpitHttpClient` as default HTTP client (#1307)

  Show description for c803a97
  Mantisus

  authored
  c803a97

  Copy full SHA for c803a97

Commits on Jul 23, 2025

• feat: Persist RequestList state (#1274)

  Show description for cc68014
  janbuchar

  authored
  cc68014

  Copy full SHA for cc68014

Commits on Jul 21, 2025

• feat: add `impit` option for Crawlee CLI (#1312)

  Show description for 508d7ce
  Mantisus

  authored
  508d7ce

  Copy full SHA for 508d7ce

Commits on Jul 17, 2025

• feat: Prevent overloading system memory when running locally (#1270)

  Show description for 30de3bd
  janbuchar

  authored
  30de3bd

  Copy full SHA for 30de3bd

Commits on Jul 15, 2025

• chore: Refactor `HttpClient` implementations tests (#1299)

  Show description for 47380ef
  Pijukatel

  authored
  47380ef

  Copy full SHA for 47380ef

• feat: add `ImpitHttpClient` http-client client using the `impit` library (#1151)

  Show description for 0d0d268
  

  Mantisus

  and

  vdusek

  authored
  0d0d268

  Copy full SHA for 0d0d268

Commits on Jul 11, 2025

• feat: Add basic `OpenTelemetry` instrumentation (#1255)

  Show description for a92d8b3
  

  Pijukatel

  and

  vdusek

  authored
  a92d8b3

  Copy full SHA for a92d8b3

Commits on Jul 10, 2025

• refactor!: Change method `HttpResponse.read` from sync to async (#1296)

  Show description for 83fa8a4
  Mantisus

  authored
  83fa8a4

  Copy full SHA for 83fa8a4

Commits on Jul 9, 2025

• feat: Add crawlee-cli option to skip project installation (#1294)

  Show description for 4d5aef0
  Pijukatel

  authored
  4d5aef0

  Copy full SHA for 4d5aef0