Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
972 commits
Select commit Hold shift + click to select a range
ad1c2e0
updated .pylintrc
HariSekhon May 1, 2023
64b326a
updated README.md
HariSekhon May 5, 2023
0487abc
updated submodule bash-tools
HariSekhon May 5, 2023
493c6d1
updated submodule pylib
HariSekhon May 5, 2023
a0fed60
updated submodule templates
HariSekhon May 5, 2023
dd64db0
added kics.config
HariSekhon May 5, 2023
fee21a0
updated submodule bash-tools
HariSekhon May 5, 2023
131da36
updated submodule pylib
HariSekhon May 5, 2023
0ba9caa
updated submodule templates
HariSekhon May 5, 2023
5c929d2
updated submodule bash-tools
HariSekhon May 5, 2023
62046ed
updated submodule pylib
HariSekhon May 5, 2023
6f96ebf
updated README.md
HariSekhon May 5, 2023
afe9d7a
updated submodule bash-tools
HariSekhon May 6, 2023
c9ac6b6
updated submodule pylib
HariSekhon May 6, 2023
b2d609d
updated submodule templates
HariSekhon May 6, 2023
0341c77
Update README.md
HariSekhon May 6, 2023
472331b
updated .pylintrc
HariSekhon May 6, 2023
b3ac866
Merge branch 'master' of ssh://github.com:/HariSekhon/DevOps-Python-t…
HariSekhon May 6, 2023
93b2c4f
updated pylib
HariSekhon May 6, 2023
2c42d10
updated .pylintrc
HariSekhon May 6, 2023
7a42f40
updated spark_csv_to_avro.py
HariSekhon May 6, 2023
a282dda
updated spark_avro_to_parquet.py
HariSekhon May 6, 2023
246d4df
updated spark_csv_to_avro.py
HariSekhon May 6, 2023
dad1bce
updated spark_csv_to_parquet.py
HariSekhon May 6, 2023
49c66be
updated spark_json_to_avro.py
HariSekhon May 6, 2023
7fb4da4
updated spark_json_to_parquet.py
HariSekhon May 6, 2023
86727ce
updated spark_parquet_to_avro.py
HariSekhon May 6, 2023
ec22d9c
updated bash-tools
HariSekhon May 10, 2023
f81d2e1
updated pylib
HariSekhon May 10, 2023
1643e01
updated templates
HariSekhon May 10, 2023
dbc5cec
updated Makefile
HariSekhon May 10, 2023
bf4934f
updated all.sh
HariSekhon May 10, 2023
9a1f9be
updated anonymize_parallel.sh
HariSekhon May 10, 2023
7251c68
updated sonar-project.properties
HariSekhon May 11, 2023
7549479
updated README.md
HariSekhon May 11, 2023
01af377
added trivy.yaml
HariSekhon May 12, 2023
0d560dd
updated README.md
HariSekhon May 12, 2023
585e905
updated trivy.yaml
HariSekhon May 13, 2023
92b23f8
updated README.md
HariSekhon May 13, 2023
9fe0d3c
updated README.md
HariSekhon May 13, 2023
b8c21da
added grype.yaml
HariSekhon May 14, 2023
a8c29b4
updated center.py
HariSekhon May 29, 2023
f9abc5f
removed codeship.yml
HariSekhon Jun 2, 2023
c4c513b
removed wercker.yml
HariSekhon Jun 2, 2023
116cdfd
removed .werckerignore
HariSekhon Jun 2, 2023
5ba24dc
moved .teamcity.vcs.json to teamcity/
HariSekhon Jun 2, 2023
1730b69
moved .teamcity.vcs.oauth.json to teamcity/
HariSekhon Jun 2, 2023
21d86fe
moved .teamcity.vcs.ssh.json to teamcity/
HariSekhon Jun 2, 2023
637c5ad
moved .concourse.yml to cicd/
HariSekhon Jun 2, 2023
424a095
moved .gocd.yml to cicd/
HariSekhon Jun 2, 2023
2451e74
moved buildspec.yml to cicd/
HariSekhon Jun 2, 2023
fca148a
moved cloudbuild.yaml to cicd/
HariSekhon Jun 2, 2023
caf90ee
removed shippable.yml
HariSekhon Jun 2, 2023
7d04cce
updated .appveyor.yml
HariSekhon Jun 2, 2023
00b3cf9
updated pipeline.yml
HariSekhon Jun 2, 2023
526798d
updated config.yml
HariSekhon Jun 2, 2023
126ad67
updated .cirrus.yml
HariSekhon Jun 2, 2023
243482c
updated .drone.yml
HariSekhon Jun 2, 2023
84d0b04
updated .gitlab-ci.yml
HariSekhon Jun 2, 2023
c21088d
updated sonar-project.properties
HariSekhon Jun 2, 2023
2c93d26
updated sonar-project.properties
HariSekhon Jun 2, 2023
3b6c0b0
updated semaphore.yml
HariSekhon Jun 2, 2023
7e975e2
updated README.md
HariSekhon Jun 2, 2023
97a95b0
updated azure-pipelines.yml
HariSekhon Jun 2, 2023
e7b73f1
updated buddy.yml
HariSekhon Jun 2, 2023
3f82815
updated .concourse.yml
HariSekhon Jun 2, 2023
3851ded
updated .gocd.yml
HariSekhon Jun 2, 2023
f7dda88
updated codefresh.yml
HariSekhon Jun 2, 2023
0865b14
updated kics.config
HariSekhon Jun 2, 2023
0ba0524
updated gocd_config_repo.json
HariSekhon Jun 2, 2023
f605276
updated submodule bash-tools
HariSekhon Jun 2, 2023
37b7994
updated submodule pylib
HariSekhon Jun 2, 2023
0d7d806
updated submodule sql
HariSekhon Jun 2, 2023
d1ef74f
updated submodule templates
HariSekhon Jun 2, 2023
a3634ec
updated codeowners.yaml
HariSekhon Jun 2, 2023
79fdd3e
updated fork-sync.yaml
HariSekhon Jun 2, 2023
6900c0b
updated fork-update-pr.yaml
HariSekhon Jun 2, 2023
02e4b41
updated json.yaml
HariSekhon Jun 2, 2023
77f1608
updated kics.yaml
HariSekhon Jun 2, 2023
70a101b
updated shellcheck.yaml
HariSekhon Jun 2, 2023
55a9f67
updated trivy.yaml
HariSekhon Jun 2, 2023
b5f76c8
updated validate.yaml
HariSekhon Jun 2, 2023
88ac6b6
updated xml.yaml
HariSekhon Jun 2, 2023
2c992b8
updated yaml.yaml
HariSekhon Jun 2, 2023
a2a575e
updated submodule bash-tools
HariSekhon Jun 2, 2023
202d2ed
updated submodule pylib
HariSekhon Jun 2, 2023
25abbfd
updated submodule sql
HariSekhon Jun 2, 2023
24407a2
updated submodule templates
HariSekhon Jun 2, 2023
82da083
updated submodule bash-tools
HariSekhon Jun 2, 2023
4b432be
updated submodule pylib
HariSekhon Jun 2, 2023
e144142
updated submodule templates
HariSekhon Jun 2, 2023
baec6ac
updated README.md
HariSekhon Jun 2, 2023
f785220
updated README.md
HariSekhon Jun 2, 2023
e9e5b51
updated README.md
HariSekhon Jun 2, 2023
9174e4c
updated bash-tools
HariSekhon Jun 14, 2023
233f723
updated pylib
HariSekhon Jun 14, 2023
61b5584
updated sql
HariSekhon Jun 14, 2023
86634b0
updated templates
HariSekhon Jun 14, 2023
4f8d913
major library update to avoid re.error: global flags not at the start…
HariSekhon Jun 14, 2023
fe09bf1
updated Jenkinsfile
HariSekhon Jun 14, 2023
ecacb66
updated bash-tools
HariSekhon Jun 14, 2023
bb927b6
updated pylib
HariSekhon Jun 14, 2023
5fe0532
updated templates
HariSekhon Jun 14, 2023
2e4972e
renamed .github/workflows/debian_9.yaml to .github/workflows/debian_9…
HariSekhon Jul 1, 2023
c76c203
updated README.md
HariSekhon Jul 1, 2023
d3b39e3
added debian_12.yaml
HariSekhon Jul 1, 2023
168259b
updated debian_12.yaml
HariSekhon Jul 1, 2023
ae2d96a
updated README.md
HariSekhon Jul 1, 2023
ad3c11b
updated anonymize_custom.conf
HariSekhon Jul 6, 2023
b91f069
Merge branch 'master' of ssh://github.com:/HariSekhon/DevOps-Python-t…
HariSekhon Jul 6, 2023
2e7f207
updated submodule bash-tools
HariSekhon Jul 6, 2023
dca37e7
updated submodule pylib
HariSekhon Jul 6, 2023
e6daf72
updated submodule templates
HariSekhon Jul 6, 2023
221dbda
Update README.md
HariSekhon Jul 29, 2023
a95fe93
updated bash-tools
HariSekhon Nov 14, 2023
a072cbe
updated pylib
HariSekhon Nov 14, 2023
48f4a1a
updated sql
HariSekhon Nov 14, 2023
f4e0b56
updated templates
HariSekhon Nov 14, 2023
970e584
updated bash-tools install script paths
HariSekhon Feb 8, 2024
abe3764
updated submodule bash-tools
HariSekhon Feb 9, 2024
a23f87d
updated submodule pylib
HariSekhon Feb 9, 2024
cf0e068
updated submodule templates
HariSekhon Feb 9, 2024
9ca96af
updated bash-tools
HariSekhon Feb 23, 2024
49fcf4f
updated pylib
HariSekhon Feb 23, 2024
5f42a43
updated templates
HariSekhon Feb 23, 2024
7cdc43c
updated README.md
HariSekhon Mar 7, 2024
b5db3cb
updated bash-tools
HariSekhon Apr 24, 2024
8e50ccb
updated templates
HariSekhon Apr 24, 2024
a2d58fa
updated bash-tools
HariSekhon Apr 24, 2024
e0ab19a
Merge branch 'master' of https://github.com/HariSekhon/DevOps-Python-…
HariSekhon May 16, 2024
39a4591
added .envrc
HariSekhon May 27, 2024
95e3fae
Merge branch 'master' of https://github.com/HariSekhon/DevOps-Python-…
HariSekhon Jun 3, 2024
a0d2bc4
updated .envrc
HariSekhon Jun 4, 2024
0f9f99f
updated .envrc
HariSekhon Jun 4, 2024
92451e7
updated bash-tools
HariSekhon Jun 4, 2024
eef5f92
updated pylib
HariSekhon Jun 4, 2024
9616644
updated templates
HariSekhon Jun 4, 2024
7dd1077
updated bash-tools
HariSekhon Jun 26, 2024
aa3ef77
updated pylib
HariSekhon Jun 26, 2024
749724f
updated templates
HariSekhon Jun 26, 2024
d8cbf43
updated pylib
HariSekhon Jun 26, 2024
21f5349
updated .envrc
HariSekhon Jun 26, 2024
8215411
updated bash-tools
HariSekhon Jun 26, 2024
899a4ce
updated pylib
HariSekhon Jun 26, 2024
a632876
updated submodule bash-tools
HariSekhon Jun 26, 2024
18cc287
updated submodule pylib
HariSekhon Jun 26, 2024
1f6f019
updated submodule sql
HariSekhon Jun 26, 2024
e805b2a
updated submodule templates
HariSekhon Jun 26, 2024
86d645a
updated .envrc
HariSekhon Jul 2, 2024
c6fcf30
updated bash-tools
HariSekhon Jul 2, 2024
15816a2
updated pylib
HariSekhon Jul 2, 2024
959c4ce
updated .flake8
HariSekhon Jul 2, 2024
06d5e94
updated bash-tools
HariSekhon Jul 2, 2024
49075c2
updated pylib
HariSekhon Jul 2, 2024
cd4e61a
updated templates
HariSekhon Jul 2, 2024
ec92f71
added .envrc-python
HariSekhon Aug 8, 2024
bae58f9
updated .envrc
HariSekhon Aug 8, 2024
13b3cde
added .pre-commit-config.yaml
HariSekhon Aug 8, 2024
5c145c7
updated .pre-commit-config.yaml
HariSekhon Aug 8, 2024
c8c6623
updated .envrc
HariSekhon Aug 9, 2024
9a5c385
updated .editorconfig
HariSekhon Aug 9, 2024
f410868
updated .envrc
HariSekhon Aug 9, 2024
283a9a3
updated .envrc
HariSekhon Aug 10, 2024
f09fdd3
updated .envrc
HariSekhon Aug 14, 2024
d31b9e2
updated README.md
HariSekhon Aug 15, 2024
f3c5690
updated .pre-commit-config.yaml
HariSekhon Aug 22, 2024
4546c76
added .markdownlint.rb
HariSekhon Aug 22, 2024
db58f53
updated .pre-commit-config.yaml
HariSekhon Sep 3, 2024
0839b2b
added .mdlrc
HariSekhon Sep 3, 2024
c8ec774
added .mdl.rb
HariSekhon Sep 3, 2024
cfa61d4
updated ci_bootstrap.sh
HariSekhon Sep 3, 2024
63bde7f
updated bash-tools
HariSekhon Sep 4, 2024
16a294f
updated pylib
HariSekhon Sep 4, 2024
c91a96c
updated sql
HariSekhon Sep 4, 2024
b53766e
updated templates
HariSekhon Sep 4, 2024
82e9390
updated README
HariSekhon Sep 4, 2024
e27764e
updated README
HariSekhon Sep 4, 2024
6259d5a
updated .mdl.rb
HariSekhon Sep 16, 2024
e4eac61
updated README
HariSekhon Sep 16, 2024
73ff2ef
updated README.md
HariSekhon Sep 16, 2024
94d58f4
updated README.md
HariSekhon Sep 16, 2024
68cdf7d
removed .markdownlint.rb
HariSekhon Sep 18, 2024
2ff0c6b
updated azure-pipelines.yml
HariSekhon Sep 21, 2024
def50a9
updated submodule bash-tools
HariSekhon Sep 21, 2024
38c0200
updated submodule pylib
HariSekhon Sep 21, 2024
566d308
updated submodule sql
HariSekhon Sep 21, 2024
fbca030
updated submodule templates
HariSekhon Sep 21, 2024
b77d999
updated submodule bash-tools
HariSekhon Sep 22, 2024
c6ab1cc
updated submodule pylib
HariSekhon Sep 22, 2024
1981197
updated submodule templates
HariSekhon Sep 22, 2024
3e40bd4
updated submodule bash-tools
HariSekhon Sep 22, 2024
5b7e885
updated submodule pylib
HariSekhon Sep 22, 2024
bff7195
updated submodule templates
HariSekhon Sep 22, 2024
c1a5672
updated requirements.txt
HariSekhon Sep 22, 2024
5c90084
updated submodule bash-tools
HariSekhon Sep 22, 2024
f373795
updated submodule pylib
HariSekhon Sep 22, 2024
2e739a4
updated bash-tools
HariSekhon Sep 22, 2024
84e699a
updated bash-tools
HariSekhon Sep 23, 2024
b580060
updated bash-tools
HariSekhon Sep 23, 2024
c9f8ba3
updated .envrc
HariSekhon Sep 23, 2024
1b5dcec
updated bash-tools
HariSekhon Oct 8, 2024
ee32cb2
updated .pre-commit-config.yaml
HariSekhon Oct 9, 2024
f040021
added markdown.yaml
HariSekhon Oct 11, 2024
0e7f289
updated README.md
HariSekhon Oct 11, 2024
ac68327
updated bash-tools
HariSekhon Nov 22, 2024
b9a12fc
updated bash-tools
HariSekhon Nov 22, 2024
5206c0f
updated .pre-commit-config.yaml
HariSekhon Nov 22, 2024
ea2ed7d
permitted space in section headers to allow for AWS [profile blah] se…
HariSekhon Nov 22, 2024
67c680b
updated .pre-commit-config.yaml
HariSekhon Nov 22, 2024
510fd69
updated test_dockerhub_search.sh
HariSekhon Nov 24, 2024
22fa4cf
updated config.yml
HariSekhon Dec 7, 2024
6b56bd2
added lint exception for on: truthy
HariSekhon Feb 1, 2025
7738761
updated bash-tools
HariSekhon Feb 1, 2025
406fce6
updated README.md
HariSekhon Feb 6, 2025
c9f6bce
changed concurrency lock to be workflow-ref format
HariSekhon Feb 14, 2025
5dbc2ec
updated .cirrus.yml
HariSekhon Feb 14, 2025
10d0ad2
updated semaphore.yml
HariSekhon Feb 22, 2025
0adb159
updated config.yml
HariSekhon Feb 22, 2025
c10d632
updated config.yml
HariSekhon Feb 22, 2025
d8d48a9
updated semaphore.yml
HariSekhon Feb 22, 2025
3204b85
updated semaphore.yml
HariSekhon Feb 22, 2025
2895d5f
updated semaphore.yml
HariSekhon Feb 22, 2025
99cf65b
updated semaphore.yml
HariSekhon Feb 22, 2025
f21e0ab
updated semaphore.yml
HariSekhon Feb 22, 2025
1ad7d99
updated .envrc
HariSekhon Feb 25, 2025
6b19388
updated bootstrap.sh
HariSekhon Mar 14, 2025
2efb7e7
updated ci_bootstrap.sh
HariSekhon Mar 14, 2025
b13623f
updated Makefile
HariSekhon Mar 14, 2025
0bba447
updated Makefile
HariSekhon Mar 14, 2025
72d01f4
updated Makefile
HariSekhon Mar 14, 2025
feb48b7
updated test_validate_multimedia.sh
HariSekhon Mar 14, 2025
5583521
added plot_uk_marriage_rates.py
HariSekhon Apr 25, 2025
1a0723e
updated requirements.txt
HariSekhon Apr 25, 2025
53def06
added uk_marriage_rates_2022.xslx
HariSekhon Apr 25, 2025
add60aa
updated plot_uk_marriage_rates.py
HariSekhon Apr 25, 2025
76d07c2
updated README.md
HariSekhon Nov 6, 2025
58f3505
updated README.md
HariSekhon Jan 9, 2026
ba4689a
updated pylib
HariSekhon Jan 9, 2026
572228d
updated sql
HariSekhon Jan 9, 2026
8c8d338
updated templates
HariSekhon Jan 9, 2026
351e282
updated bash-tools
HariSekhon Jan 9, 2026
824267a
updated pylib
HariSekhon Jan 9, 2026
58521d6
updated bash-tools
HariSekhon Jan 9, 2026
40f0b93
updated pylib
HariSekhon Jan 9, 2026
f3cb837
updated templates
HariSekhon Jan 9, 2026
555239d
updated README.md
HariSekhon Feb 3, 2026
a700795
updated bash-tools
HariSekhon Feb 3, 2026
511b9e6
updated pylib
HariSekhon Feb 3, 2026
874083a
updated sql
HariSekhon Feb 3, 2026
32ffee2
updated templates
HariSekhon Feb 3, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
71 changes: 45 additions & 26 deletions .appveyor.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,19 +4,36 @@
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/harisekhon/devops-python-tools
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
# https://www.linkedin.com/in/HariSekhon
#

# ============================================================================ #
# A p p V e y o r C I
# ============================================================================ #

# https://www.appveyor.com/docs/appveyor-yml/

image: Ubuntu

# workaround for default JDK9 have old CA certs:
#
# https://github.com/appveyor/ci/issues/3833
#
# https://www.appveyor.com/docs/getting-started-with-appveyor-for-linux/#configuring-language-stack
#
stack: jdk 15

skip_commits:
files:
- docs/*
- '**/*.md'

# https://www.appveyor.com/docs/how-to/ssh-to-build-worker/
environment:
APPVEYOR_SSH_KEY: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAvihSRU+YjBKvKiacDfUoZ7ghoVMcwNh4cWIYUNFGZosXOzNtyOcBpIb71TCgLFhOd+aMWKXCEC67BpNSIjt+a/FLD27AwmgVHv6cPlE3G0JJ9zmIrNmx9511dshTsxUW2O0SbYG+3InuO7FUkSrld+kA1OucyjgmZU7/+Cs9shpAEOaIVYmGlpDGRucAHpwtckvdgRTtnA3WNZ/Qg1vU6Ik4Xm03vjrW6lSiuTffYO1kbdcMQ4IZBlzfmovOtXQ0PomvN5NMCpgOyQuoNlvyS11tOXoqNiWOkiLE15XEzAQth9hHbNiH8jHJbAtkHqWWh0KK4IUyNGvoL6QfNxsTlw== hari@anotherdimension
Expand All @@ -37,34 +54,36 @@ on_finish:
#
# https://github.com/appveyor/ci/pull/3385
#
#- sh: curl -sflL 'https://raw.githubusercontent.com/HariSekhon/devops-python-tools/master/setup/install_openssh.sh' | bash -e -
#- sh: curl -sflL 'https://raw.githubusercontent.com/HariSekhon/DevOps-Python-tools/master/install/install_openssh.sh' | bash -e -
#
# https://www.appveyor.com/docs/how-to/ssh-to-build-worker/
- sh: if [ "$APPVEYOR_SSH_BLOCK" = true ]; then curl -sflL 'https://raw.githubusercontent.com/appveyor/ci/master/scripts/enable-ssh.sh' | bash -e -; fi

install:
# workaround for:
# Some packages could not be installed. This may mean that you have
# requested an impossible situation or if you are using the unstable
# distribution that some required packages have not yet been created
# or been moved out of Incoming.
# The following information may help to resolve the situation:
#
# The following packages have unmet dependencies:
# mssql-server : Depends: libsasl2-modules-gssapi-mit but it is not going to be installed
# E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by held packages.
# devops-python-tools/Makefile.in:272: recipe for target 'apt-packages' failed
# make[2]: *** [apt-packages] Error 123
# make[2]: Leaving directory '/home/appveyor/projects/pylib'
# devops-python-tools/Makefile.in:212: recipe for target 'system-packages' failed
#
# adding "|| :" to the end of these commands causes them to be silently ignored!
- sudo sed -i '/https:\/\/packages.microsoft.com\/ubuntu\/.*\/mssql-server/d' /etc/apt/sources.list
- sudo apt purge -qy --allow-change-held-packages mssql-server
# this prevents conflicts installing default-jdk - see https://github.com/appveyor/ci/issues/3411
#- dpkg -l | awk '/openjdk/{print $2}' | DEBIAN_FRONTEND=noninteractive xargs sudo apt-get remove -y --allow-change-held-packages
- setup/ci_bootstrap.sh
- make
# workaround for:
# Some packages could not be installed. This may mean that you have
# requested an impossible situation or if you are using the unstable
# distribution that some required packages have not yet been created
# or been moved out of Incoming.
# The following information may help to resolve the situation:
#
# The following packages have unmet dependencies:
# mssql-server : Depends: libsasl2-modules-gssapi-mit but it is not going to be installed
# E: Error, pkgProblemResolver::Resolve generated breaks, this may be caused by held packages.
# DevOps-Python-tools/Makefile.in:272: recipe for target 'apt-packages' failed
# make[2]: *** [apt-packages] Error 123
# make[2]: Leaving directory '/home/appveyor/projects/pylib'
# DevOps-Python-tools/Makefile.in:212: recipe for target 'system-packages' failed
#
# adding "|| :" to the end of these commands causes them to be silently ignored!
- sudo sed -i '/https:\/\/packages.microsoft.com\/ubuntu\/.*\/mssql-server/d' /etc/apt/sources.list
- sudo apt purge -yq --allow-change-held-packages mssql-server
# this prevents conflicts installing default-jdk - see https://github.com/appveyor/ci/issues/3411
#- dpkg -l | awk '/openjdk/{print $2}' | DEBIAN_FRONTEND=noninteractive xargs sudo apt-get remove -y --allow-change-held-packages
- setup/ci_bootstrap.sh
- make

test_script:
- make test
- make test

build: off
8 changes: 6 additions & 2 deletions .buildkite/pipeline.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,15 +4,19 @@
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/harisekhon/devops-python-tools
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
# https://www.linkedin.com/in/HariSekhon
#

# ============================================================================ #
# B u i l d K i t e C I
# ============================================================================ #

# BuildKite Pipeline
#
# add this command to the UI and it will read the rest of the steps from here:
Expand Down
48 changes: 48 additions & 0 deletions .checkov.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
#
# Author: Hari Sekhon
# Date: 2022-02-21 16:53:29 +0000 (Mon, 21 Feb 2022)
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/HariSekhon
#

# ============================================================================ #
# C h e c k o v c o n f i g
# ============================================================================ #

# https://github.com/bridgecrewio/checkov#configuration-using-a-config-file
#
# This is not well documented but the fields seem to be the same as:
#
# checkov --help
#
# See master template at:
#
# https://github.com/HariSekhon/Templates/blob/master/.checkov.yaml

---
compact: true
directory:
- .
skip-path:
- bash-tools
- pylib
- sql
- templates
docker-image: harisekhon/pytools
download-external-modules: true # without this gets lots of annoying warning lines such as '2022-02-22 16:14:40,180 [MainThread ] [WARNI] Failed to download module x/y/z:n.n.n'
framework:
- all
no-guide: true
output: cli
quiet: true
repo-id: HariSekhon/DevOps-Python-tools # what to report to Bridgecrew Cloud - without this gets annoying duplicate repos such as 'harisekhon_cli_repo/pytools'
skip-suppressions: true
soft-fail: true
46 changes: 30 additions & 16 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,36 +5,50 @@
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/harisekhon/devops-python-tools
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
# https://www.linkedin.com/in/HariSekhon
#

# https://circleci.com/docs/2.0/configuration-reference
# ============================================================================ #
# C i r c l e C I
# ============================================================================ #

# Master Template with more advanced config:
#
# https://github.com/HariSekhon/Templates/blob/master/circleci_config.yml

# Reference:
#
# https://circleci.com/docs/2.0/configuration-reference

version: 2.1

workflows:
version: 2
workflow:
jobs:
- build

jobs:
build:
# technically a docker image is a better choice than machine
# but we want to introduce some native environment variation
# between build systems in order to test the repo's build automation is robust
machine:
image: default
#image: ubuntu-1604:201903-01
# set to an actual docker image when running locally using circle_ci_job.sh
# docker image must have git installed to do the checkout
# so using harisekhon/dev:ubuntu instead of base ubuntu image
#image: harisekhon/dev:ubuntu
docker:
- image: cimg/base:2024.12
resource_class: small
steps:
# CLI is too old - config validate breaks in test - install new version to fix
# doesn't work - existing version is too old to update
#- run: circleci update
- run: |
curl -sSLf https://raw.githubusercontent.com/CircleCI-Public/circleci-cli/main/install.sh | sudo bash
- checkout
#- setup_remote_docker:
# version: 20.10.11
- run: setup/ci_bootstrap.sh
- run: make init
- run: make
# to allow docker networking to work
- run: sudo sysctl net.ipv4.ip_forward=1
- run: sudo service docker restart
- run: make test
10 changes: 8 additions & 2 deletions .cirrus.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,21 +4,27 @@
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/harisekhon/devops-python-tools
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
# https://www.linkedin.com/in/HariSekhon
#

# ============================================================================ #
# C i r r u s C I
# ============================================================================ #

# https://cirrus-ci.org/guide/writing-tasks/

container:
image: ubuntu:18.04

task:
env:
TMPDIR: /var/tmp
script:
- setup/ci_bootstrap.sh
- make init
Expand Down
58 changes: 0 additions & 58 deletions .concourse.yml

This file was deleted.

30 changes: 18 additions & 12 deletions .drone.yml
Original file line number Diff line number Diff line change
@@ -1,18 +1,24 @@
---
# XXX: putting this separator further down with code causes a parsing bug in drone lint
#
# Author: Hari Sekhon
# Date: 2020-02-29 12:05:52 +0000 (Sat, 29 Feb 2020)
#
# vim:ts=2:sts=2:sw=2:et
#
# https://github.com/harisekhon/devops-python-tools
# https://github.com/HariSekhon/DevOps-Python-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
# https://www.linkedin.com/in/HariSekhon
#

# ============================================================================ #
# D r o n e C I
# ============================================================================ #

# https://docs.drone.io/quickstart/cli/
#
# https://docs.drone.io/cli/install/
Expand All @@ -28,16 +34,16 @@ type: docker
name: default

steps:
- name: build
image: ubuntu:18.04
# environment:
# DEBUG: 1
commands:
- setup/ci_bootstrap.sh
- make init
- make ci
- make test
- name: build
image: ubuntu:18.04
#environment:
# DEBUG: 1
commands:
- setup/ci_bootstrap.sh
- make init
- make ci
- make test

trigger:
branch:
- master
- master
Loading