In article ,
says...
Is it because, in the real world outside of your fantasies of
importance, Wandex is in fact "widely accepted as the world's first
search engine"?

See also section 1.2, para 2, of

http://www.farcaster.com/papers/ifish/ifish-tr.pdf

The stuff about collecting only "TITLE" information isn't quite
right, I don't think, but I have no solid evidence to back that up. As
I recall, it started by looking at just the page's HEAD section, but
when he realised that mostly he was getting the whole page anyway he
started to have the crawler look at document headings as well.
Something like that.
--
SAm.