Talk:Internet Archive

robots.txt

Also if web archive has archived a site then the robots.txt changes to "do not crawl" will web archive delete the saved pages from existence or just hide them?

archive.is doesn't care about robots.txt! User000name (talk) 19:54, 19 June 2016 (UTC)