Enduro is a tool designed to automate the processing of transfers in multiple Archivematica pipelines. It's part of a preservation solution that is being used by the National Health Archive (NHA) and the National Center for Truth and Reconciliation (NCTR).

It's a proof of concept at its very early stages. It aims to cover our client's needs while exploring new and innovative ways to build durable and fault-tolerant workflows suited for preservation.

https://enduroproject.netlify.app/docs/development/environment/

To clone this branch from scratch use: git clone --recurse-submodules https://github.com/penwern/enduro.git Otherwise the submodules will need to be pulled: git submodule update --init --recursive

You will need to edit the enduro.toml [pipeline] section with your Archivematica details

Python 3.9 - for scripts

• python3.9 pip - curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py and python3.9 get-pip.py
  • xmltodict - python3.9 -m pip install xmltodict
  • metsrw - python3.9 -m pip install metsrw
    • Error: python setup.py egg_info did not run successfully.
    • Solution: python3.9 -m pip install --upgrade setuptools

Java 8 - for Commons IP Validator

Once Enduro has been set up you will be able execute the workflow.

SIPs to be processed through the workflow should be placed in the sips/ directory. Currently, SIPs are not deleted from the sips/ directory after processing. Resulting E-Ark AIPs will be found in the eark_aips/ directory. Validation reports for both can be found in their respective directories.

Example command to run the workflow: ./hack/cadence.sh wf start --wid="eark-aip-generator" --wt="eark-aip-generator" --wrp="1" --tl="global" --et="3600"

We have extended the API service to include the service E-Ark. Currently, this service executes our eark-aip-generator workflow, creating E-Ark compliant AIPS, using SIPs in the sips/ directory and outputting into eark_aips/.

POST /eark

• Runs the workflow.

GET /eark

• Gets the status of the running/last run workflow.

Visit https://enduroproject.netlify.com for more details.