Google's robots.txt http://www.google.com/robots.txt disallows /search but not /... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		roland-s on Sept 10, 2014 \| parent \| context \| favorite \| on: Google search indexes itself Google's robots.txt http://www.google.com/robots.txt disallows /search but not //search. However, if you search site:http://www.google.com/search and show omitted search results, you get a bunch of results (all 404s). If you do this there are some strange results on the last couple pages. For example: Obama won't salute the flag \| Phallectomy \| horse+mating+video \| feral+horses+induced+abortion \| Lactating+dog+images \| animal+mating+video \| mating+mpg+-beastiality+-... So, Half Life 3 confirmed.

marceldegraaf on Sept 10, 2014 [–]

I thought you were joking about those search keywords, but indeed: http://i.marceldegraaf.net/sitehttpwww.google.comsearch_-_Go... (screenshot)

user24 on Sept 11, 2014 | | [–]

ODF files! Those sick sick people.

vadvi on Sept 11, 2014 | | [–]

why is it "GooooooooooG" and not "Goooooooooogle" at the bottom?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact