[Sigia-l] Site map generator?

[Listera]

Eric Scheid:

>>> The relationships that can be inferred from a spidering/clustering tool
>>> can range from the very basics (with tools like Xenu), based on folder
>>> structure, to more complex relationships (with tools that do clustering
>>> analysis, etc). But they are mostly dumb tools, they just follows links.
>> 
>> <http://www.google.com/>
> 
> please explain how one might use google to generate a site map.

One would start with reading the actual *quoted* passage above, to which I
responded in jest.
Then one would think how a spidering/clustering tool, not unlike Google for
example, manages to discover relationships, rankings, structures, etc.
So one would reach the conclusion that "just following" links can tell one a
lot. (About $120 billion worth actually.)
As to whether one can write a fairly trivial program to automate Google's
search to use "link:" iteratively to map out a website, I'll leave it up to
the reader as a meaningless exercise.

----
Ziya

"Innovate as a last resort."