CKAN 2.10.4 getting 500 internal server error when reading large datsets such as https://open.africa/dataset/chirps-rainfall-data.

Nginx, proxy_read_timeout set at 300s

CKAN Nginx error logs

2024/10/23 08:55:33 [error] 381225#381225: *65465 upstream prematurely closed connection while reading response header from upstream, client: 41.72.206.78, server: openafrica.net, request: "HEAD /dataset/chirps-rainfall-data HTTP/2.0", upstream: "http://172.17.0.8:5000/dataset/chirps-rainfall-data", host: "open.africa", referrer: "https://open.africa/dataset/chirps-rainfall-data"