Skip to content

Releases: simonsdave/cloudfeaster

v0.9.59

10 Jan 02:25
@simonsdave simonsdave
v0.9.59
c3c09d7
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.59 Latest
Latest

Added

  • Nothing

Changed

  • install-chrome.sh was failing - error message suggested it needs
    an apt-get update -y before apt-get install so added the
    update
  • dev-env 0.6.19 -> 0.6.21
  • change generate-circleci-config.py to start
    using CircleCI Scheduled Pipelines

Removed

  • Nothing
Assets 4
Loading

v0.9.58

04 Jan 02:59
@simonsdave simonsdave
v0.9.58
b89f553
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.58

Added

  • added resource_class: medium to the CircleCI config
    generated by generate-circleci-config.py

Changed

  • dev-env 0.6.17 -> 0.6.19

Removed

  • Nothing
Assets 4
Loading

v0.9.57

03 Jan 04:11
@simonsdave simonsdave
v0.9.57
e24d5c1
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.57

Added

  • added sample spider alpine_releases.py
  • added --pretty command line option to run-sample.sh
  • simple approach to skipping CircleCI build, test and deploy of
    runtime and runtime lite docker images - very useful during
    development when upgrading major things like Python and/or OS
    versions
  • added explicit resource class
    to CircleCI config

Changed

  • dev-env 0.6.13 -> 0.6.17
  • python-dateutil 2.8.1 -> 2.8.2
  • selenium 3.141.0 -> 4.1.0
  • bin/install-chromedriver.sh was failing for newer versions of chromium because
    the format returned by "chromium-browser --version" changed - fix this problem
  • for runtime lite Alphe base image 3.12 -> 3.15
  • refined bin/install-chromedriver.sh output when installing on Alpine
  • simonsdave/bionic-dev-env:v0.6.14 -> simonsdave/focal-dev-env:v0.6.16
  • fixed install-chrome.sh usage message
  • added 2022 to License

Removed

  • removed LGTM workflows and badges in main README.md
Assets 4
Loading

v0.9.56

09 Mar 12:08
@simonsdave simonsdave
v0.9.56
4b47a3a
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.56

Added

  • Nothing

Changed

  • fixed how generate-circleci-config.py uses/calls int-test-run-all-spiders-in-ci-pipeline.py

Removed

  • Nothing
Assets 4
Loading

v0.9.55

04 Mar 23:56
@simonsdave simonsdave
v0.9.55
19cee73
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.55

Added

  • Nothing

Changed

  • fixed a silly bug in int-test-run-all-spiders-in-ci-pipeline.py and how
    it made the command unusable - also put in real python logging for this command
    and real command line option handling

Removed

  • Nothing
Assets 4
Loading

v0.9.54

04 Mar 05:09
@simonsdave simonsdave
v0.9.54
f02a07e
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.54

Added

  • Nothing

Changed

  • update generate-circleci-config.py to eliminate the need for requirements.txt
    in spider repos
  • runtime docker images no longer samples init.py as executable

Removed

  • Nothing
Assets 4
Loading

v0.9.53

03 Mar 13:12
@simonsdave simonsdave
v0.9.53
c869154
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.53

Added

  • added optional --samples command line option to spiders.py
  • added optional samples argument to SpiderDiscovery() constructor
  • added categories to spider metadata - if no categories are specified
    then the name of the package containing the spider is assumed to be the
    category name - only place that categories are current used is in the API
    as a means to group spiders
  • added absoluteFilename property to spider metadata - this value is
    generated by Cloudfeaster
  • added fullyQualifiedClassName property to spider metadata - this value is
    generated by Cloudfeaster

Changed

  • docker based development environment now parses repo's setup.py for pre-reqs
    that need to be install when the development docker image is built - this
    change enabled the removal of requirements.txt from the repo's root directory
  • change format of metadata returned by spiders.py and cloudfeaster.spider.Spider

Removed

  • Nothing
Assets 4
Loading

v0.9.52

30 Jan 03:32
@simonsdave simonsdave
v0.9.52
babbb08
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.52

Added

  • Circle CI pipeline now saves generated python distributions as Circle CI artifacts
  • added int-test-run-all-spiders-in-ci-pipeline.py which is intended for use
    in spider repo CI pipelines

Changed

  • Nothing

Removed

  • Nothing
Assets 4
Loading

v0.9.51

24 Jan 22:03
@simonsdave simonsdave
v0.9.51
b374fb3
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.51

Added

  • use update-alternatives in runtime docker image so python "points to" python3.7

Changed

  • cloudfeaster-lite docker image is now based on Alpine 3.12 (used to be Alpine 3.8)

  • install-chrome.sh now able to install both Chrome
    and Chromium based on command line switches

  • install-chromedriver.sh determines which version of chromedriver to install based
    on which version of Chrome or Chromium
    is installed - see this
    for a complete description of the version selection process

  • default Chrome command line options are now

    • --headless
    • --window-size=1280x1024
    • --no-sandbox
    • --disable-dev-shm-usage
    • --disable-gpu
    • --disable-software-rasterizer
    • --single-process
    • --user-agent=Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.86 Safari/537.36

Removed

  • Nothing
Assets 4
Loading

v0.9.50

29 Dec 17:05
@simonsdave simonsdave
v0.9.50
37aadb2
This commit was signed with the committer’s verified signature.
simonsdave Dave Simons
GPG key ID: 2D1B82149CC03D97
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.9.50

Added

  • Nothing

Changed

  • install-dev-env-scripts.sh now requires virtual env
  • dev-env v0.6.12 -> v0.6.13

Removed

  • Nothing
Assets 4
Loading