RootsWeb.com Mailing Lists
Total: 1/1
    1. Re: [FreeHelp] FREEPAGES-HELP E-mail address harvesting -- was Digest, Vol 6, ...
    2. I'm not sure about Freepages but I know in many areas of RootsWeb staff monitors which spiders are allowed access to the sites. So there are other checks in place in addition to someone using the robots.txt file. Joan In a message dated 8/4/2011 4:08:33 A.M. Eastern Daylight Time, listadr@gmail.com writes: FWIW, the robots.txt file for the freepages subdomain is useless to the point of irrelevancy. jim

    08/03/2011 10:21:32