Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Sep 18, 2024

• cleanup

  hargup

  committed
  66e5d42

Commits on Aug 26, 2024

• fix: Improve logging and validation for cookie setting in web scraping

  hargup

  committed
  cc4d316

• update the start script

  hargup

  committed
  6309cbd

Commits on Aug 15, 2024

• set cookies properly

  hargup

  committed
  66183d8

• feat: use urlToCrawl in cookie url

  hargup

  committed
  49a90ee

• fix: Update crawler.ts to log cookies

  hargup

  committed
  dcc3e52

• feat: Read cookies from x-set-cookie header and set those cookies in crawlOpts, the url needs to be read from the request parameters

  hargup

  committed
  1a5f2eb

• manually set cookie

  hargup

  committed
  fc0023f

• Revert "WIP: Cookie fixes"

  hargup

  committed
  9534292

• WIP: Cookie fixes

  hargup

  committed
  12850d7

• Update README.md

  hargup

  authored
  bb3f6b3

• remove empty file

  hargup

  committed
  abef290

• update installation/usage instruction

  hargup

  committed
  f60a2a1

• docs: Add setup and usage instructions to README

  hargup

  committed
  aa0dcea

• finish responding properly

  hargup

  committed
  a7fbe3c

• Parse request headers properly

  hargup

  committed
  7677ec7

• more console logs

  hargup

  committed
  19dc9df

• fix: Improve header handling in CrawlerOptions.from()

  hargup

  committed
  f6ee7ca

• feat: Add logging for scrapping options context

  hargup

  committed
  c771354

Commits on Aug 14, 2024

• more console logs

  hargup

  committed
  77be0d0

• feat: Add console.log statements to crawler.ts

  hargup

  committed
  56c1d46

• add an express endpoint to run the crawl endpoint

  hargup

  committed
  3e2bf6d

• feat: Add Express server with crawl endpoint

  hargup

  committed
  57b0750

• feat: Add express server for crawling functionality

  hargup

  committed
  32263c7

• increase memory limit

  hargup

  committed
  1d8b3ea

• feat: add hello world endpoint in firebase cloud functions

  hargup

  committed
  b682ee5

• update deps

  hargup

  committed
  f927aab

• fix the puppeteer thingy

  hargup

  committed
  54aae97

• fix: Add try-catch block to handle errors in salvage method

  hargup

  committed
  a72373f

• fix: Make the salvage method private in the puppeteer service

  hargup

  committed
  888546e

• fix: Remove private modifier from salvage method

  hargup

  committed
  ef13836

• fix: Improve error handling and add retry mechanism in PuppeteerControl

  hargup

  committed
  f6f3fc5

• fix: Implement retry mechanism and improve error handling for scraping function

  hargup

  committed
  a3a299f

• fix the logger thingy

  hargup

  committed
  ddbf003

• feat: Add shared module dependencies and exports

  hargup

  committed
  a3f2226

Pagination

PreviousNext