* Update README.md

* feat: Update README.md

* fix: Resolving issues as yet unresolved.

* fix: black issue

* fix: resolved datatype date not known

* fix: Added partitioning and clustering. Not production ready.

* fix: Works for landsat_index

* fix: Added sentinel-2 pipeline as well as clustering.

* fix: Clean up.

* fix: attempt to resolve pod not started.

* fix: various fixes to pipeline.yaml which caused 'pod not started' issues.  Added bigquery to requirements.txt

* fix: Resolve resource issues in pipeline.yaml.

* fix: Moved schema JSON files as per code review request.

* fix: Exposed variable values into pipeline.yaml as per code review.

* Update pipeline.yaml

Co-authored-by: Adler Santos <[email protected]>

* fix: Resolving issues as yet unresolved.

* fix: black issue

* fix: resolved datatype date not known

* fix: submit new changes following issues in production after deployment.

* fix: miscellaneous fixes.

* fix: Annual summaries now works.

* fix: co_hourly_summary now successful.

* fix: black hook issues

* fix: data type corrections for some fields.

* fix: Resolved file naming breaking issue in ozone_hourly pipeline. Not production ready.

* fix: Now fixed annual summaries.  Ready for AF test in dev.

* fix: Tested full load all pipelines.

* fix: Replicate full load fixes into incremental load dag.

* fix: Resolved black hooks

* feat: onboarding early un sdg version

* feat: onboarding early un sdg version

* feat: Initial checkin.  Not production ready.

* fix: loads test data into dataframe.  Not production ready.

* fix: issues with datatypes when loading data.

* fix: Tested locally. runs as intended.

* fix: Changes to variables in pipeline.yaml preparing for multiple pipelines.

* fix: misc changes.  not ready for production.

* fix: completed loading one file from end-to-end.

* fix: expanded pipeline.yaml to include all data files for download and processing

* fix: Added deletion of source data if it is being reloaded.

* fix: next update

* fix: Testing in AF.

* fix: Increased number of nodes in cluster in AF to ensure resources are available for running the pipelines.

* fix: Resolved download file reference in code.

* fix: Fixed delete source data function.

* fix: resolved yaml lint issues

* fix: black errors

* fix: black errors

* fix: code fix, production ready

* fix: Fixed the bad charecters from data giving loading issues. Production ready

* chore(main): release 4.1.0

* Update CHANGELOG.md

Co-authored-by: release-please[bot] <55107282+release-please[bot]@users.noreply.github.com>
Co-authored-by: Adler Santos <[email protected]>