Finding orphan pages in web site?

[heikole]

Do we have an ebuild in Gentoo which makes it possible to find orphan pages in a web site? If not so, does anybody know an "external" tool?

Orphan pages should be defined here as pages that reside in a web site, but are not linked to from any other page.

THX
Heiko

[Taladar]

Theoretically you should be able to mirror the website with wget. Then you can diff the mirror and the original to find files that were not downloaded (and thus not linked from anywhere). To make sure this works disable automatic directory index generation.

Of course I never tried this but I see no way for wget to download unlinked websites without an automatic directory index.

[heikole]

Thanks for your suggestion, but it's not exactly what I mean. Actually, I would like it most to find orphan pages (or files) even locally in my originating directory, not only at my remote site.

CU Heiko
_________________
42