ftp archives disappearing?

Jim Leonard trixter at oldskool.org
Sun Mar 11 01:28:54 CST 2007

Al Kossow wrote:
> Google doesn't spider for filenames, just content. If a list of filenames
> doesn't show up on a web page, Google won't see it.

Wrong.  See below.

> As an example, I just did a search for "adsMstr_6-76.log"
> which can be found at http://bitsavers.org/bits/Datapoint/cassetteDumps/
> and there were no hits from google, yahoo, altavista, or google code 
> search.

That's because it wasn't indexed.  A search for "20164_dos.c_1.1.bin" 
does indeed point to bitsavers, which was indexed.

Maybe you have a robots.txt somewhere?  Try re-submitting your site to 
the engines again.
Jim Leonard (trixter at oldskool.org)            http://www.oldskool.org/
Help our electronic games project:           http://www.mobygames.com/
Or check out some trippy MindCandy at     http://www.mindcandydvd.com/
A child borne of the home computer wars: http://trixter.wordpress.com/

More information about the cctalk mailing list