Two arguments additional_http_error_status_codes and ignore_http_error_status_codes currently exists both on BasicCrawler and HttpClient. They are used to modify behavior of crawler based on the specific response status codes.
Remove those arguments from HttpClient, but do retain Crawler functionality by relying only on the arguments in the Crawler.
Relates to:
#959
#830
Two arguments
additional_http_error_status_codesandignore_http_error_status_codescurrently exists both onBasicCrawlerandHttpClient. They are used to modify behavior of crawler based on the specific response status codes.Remove those arguments from
HttpClient, but do retain Crawler functionality by relying only on the arguments in the Crawler.Relates to:
#959
#830