[index] [prev] [next] [options] [help]

eprints_tech messages

[EP-tech] Antwort: Linkcheck: HEAD method ends up in 404

From: Martin Braendle via Eprints-tech <eprints-tech AT ecs.soton.ac.uk>
Date: Wed, 22 Jul 2020 07:55:05 +0200





Hi,

just to bring up that topic again: perl_lib/EPrints/Apache/CRUD.pm should
allow HEAD requests for https://{repo}/id/eprint/{xy}/  - that is why we
wonder that EPrints returns a 404 ?

We observe that not only with our repo, but with other EPrints repos as
well, e.g.

curl  
"https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadoc.bib.uni-mannheim.de%2Fid%2Feprint%2F3147%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=kBNkp%2BkGH%2FqDK9p1nHkPPPi4KJs3OqxzBHEYbrCH8Bs%3D&amp;reserved=0"   yields the page
curl --head 
"https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fmadoc.bib.uni-mannheim.de%2Fid%2Feprint%2F3147%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=kBNkp%2BkGH%2FqDK9p1nHkPPPi4KJs3OqxzBHEYbrCH8Bs%3D&amp;reserved=0"  yields
HTTP status 404!

So this must be a general bug of EPrints and it is not working according to
the specification in perl_lib/EPrints/Apache/CRUD.pm

Kind regards,

Martin

--
Dr. Martin Brändle
Zentrale Informatik
Universität Zürich
Stampfenbachstr. 73
CH-8006 Zürich



Von:	"Martin Braendle via Eprints-tech"
            <eprints-tech AT ecs.soton.ac.uk>
An:	<eprints-tech AT ecs.soton.ac.uk>
Datum:	14.07.2020 14:12
Betreff:	[EP-tech] Linkcheck: HEAD method ends up in 404
Gesendet von:	<eprints-tech-bounces AT ecs.soton.ac.uk>



Hi out there

we're working on a linkchecker to remove all gone official and related
links in our Repo. Some of the URLs return to our own Repo and lickchecker
gets an ugly 404 although the publications exist.

So, what we're doing is some LWP::UserAgent  stuff, a simple get HEAD of
the URL an then analyze the response. If there was a '$status_code ==
HTTP_METHOD_NOT_ALLOWED' we would try a GET and all together we're doing
some delay/retry/timeout handling. But in the end we allways catch a
404 :-(

Additional information
- We use a 404 handler
- We're allowed to use Get, Put, Trace, Options - all fine, only HEAD
method results in a 404 ?!?
- We use the redirect from 
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2F1&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=fM0GyDdSHXLoh54o3C7UNuPQZ%2BB49rSupGQAh4%2F5Ydk%3D&amp;reserved=0 =>
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2Fid%2Feprint%2F1%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=mWKzNq571Y0B%2Bm5ETOV2UXWNJqaladVR27DYtB65Lxw%3D&amp;reserved=0 and it only seems to concern this
dynamic type of content; static pages work fine.

Let's show some examples via CURL:

[zora]$ curl -i -X HEAD -L 
"https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2F1&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=fM0GyDdSHXLoh54o3C7UNuPQZ%2BB49rSupGQAh4%2F5Ydk%3D&amp;reserved=0" (
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2F1&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=fM0GyDdSHXLoh54o3C7UNuPQZ%2BB49rSupGQAh4%2F5Ydk%3D&amp;reserved=0')
HTTP/1.1 303 See Other
Date: Tue, 14 Jul 2020 11:49:08 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips
mod_perl/2.0.11 Perl/v5.16.3
Location: /id/eprint/1

HTTP/1.1 303 See Other
Date: Tue, 14 Jul 2020 11:49:13 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips
mod_perl/2.0.11 Perl/v5.16.3
Allow: GET,HEAD,PUT,OPTIONS
Location: 
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2Fid%2Feprint%2F1%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=mWKzNq571Y0B%2Bm5ETOV2UXWNJqaladVR27DYtB65Lxw%3D&amp;reserved=0
Strict-Transport-Security: max-age=15780000

HTTP/1.1 404 Not Found
Date: Tue, 14 Jul 2020 11:49:18 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips
mod_perl/2.0.11 Perl/v5.16.3
Cache-Control: no-store, no-cache, must-revalidate
Strict-Transport-Security: max-age=15780000
Content-Type: text/html; charset=utf-8



[zora]$ curl -i -X HEAD -L 
"https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=NAM7nGxnBjCUehzT76Enr1ZT5bRMwAcigePSCEIaY7w%3D&amp;reserved=0" (
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=NAM7nGxnBjCUehzT76Enr1ZT5bRMwAcigePSCEIaY7w%3D&amp;reserved=0')
HTTP/1.1 200 OK
Date: Tue, 14 Jul 2020 11:49:31 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips
mod_perl/2.0.11 Perl/v5.16.3
Expires: Thu, 13 Aug 2020 11:49:31 GMT
Cache-Control: no-store, no-cache, must-revalidate
Vary: Accept-Encoding
Strict-Transport-Security: max-age=15780000
Content-Type: text/html; charset=utf-8



[zora]$ curl -i -X HEAD -L 
"https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2Fhelp%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=nHj10nQ5K8GkB6xNy65ZHMNCQQ3%2BfX1UiU%2F5zUA2BDQ%3D&amp;reserved=0" (
https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.zora.uzh.ch%2Fhelp%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=nHj10nQ5K8GkB6xNy65ZHMNCQQ3%2BfX1UiU%2F5zUA2BDQ%3D&amp;reserved=0')
HTTP/1.1 200 OK
Date: Tue, 14 Jul 2020 11:49:53 GMT
Server: Apache/2.4.6 (Red Hat Enterprise Linux) OpenSSL/1.0.2k-fips
mod_perl/2.0.11 Perl/v5.16.3
Expires: Thu, 13 Aug 2020 11:49:53 GMT
Cache-Control: no-store, no-cache, must-revalidate
Vary: Accept-Encoding
Strict-Transport-Security: max-age=15780000
Content-Type: text/html; charset=utf-8


Does anybody has any suggestion, solution, hint?

Kind gerads from Zürich
Martin & Jens
*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech
*** Archive: 
https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.eprints.org%2Ftech.php%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=QWuaijzSDUEii60qYwGI6Y%2Fpg58VCwv6jNyNxyCVeU0%3D&amp;reserved=0
*** EPrints community wiki: 
https://eur03.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwiki.eprints.org%2F&amp;data=01%7C01%7Ceprints-tech%40ecs.soton.ac.uk%7Cfff23f61b151468f3c6808d82e03cba4%7C4a5378f929f44d3ebe89669d03ada9d8%7C0&amp;sdata=u2BDmuZsVrC%2FF%2BWMzJfWM96lFr88UmEHb0hCwHV%2BeWs%3D&amp;reserved=0

ATTACHMENT: message.html!

*** Options: http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech *** Archive: http://www.eprints.org/tech.php/ *** EPrints community wiki: http://wiki.eprints.org/

[index] [prev] [next] [options] [help]