Whitehouse robots.txt
A robots.txt file on a web site instructs search engines to ignore certain pages. Basically, this is a list of web pages on whitehouse.gov that they don’t want search engines to keep a record of.
-
Site Search
- enter search term:
-
Related Posts
- Sexed Robots
- Combat robots wow crowds
- Robots work in swarms and hive
- Carnal Knowledge: Sex with robots? Soon, he predicts
- Iraqi War Robots Recalled Following Alarming Behavior
- Major Piracy Bust Against Top Providers
- What a cock-up over email
- Crows hack into internest
- Hit man to Pittsburgh professionals: Pay up or die
- Prisoners Of YouTube
-
Recent Posts
- The Dark Son of Moonface
- Stjepan Hauser and Luka Sulic - Smooth Criminal
- Police issue paedophile warning over 'Pedobear' internet joke
- Tom Waits - God's Away On Business
- Vile paedophiles tried to prey on each other as they searched for victims on internet
- Mortgage worker got drunk, shot computer server
- Dub Fx
- Tired Gay succumbs to Dix in 200 meters
- Cannabis and tobacco smoke are not equally carcinogenic
- Truck driver dies staging phony accident
-
Categories
- 1984, ai, animation, anus, art, audio, balls, biomed, chemistry, clever, creationism, crime, death, doom, drink, drugs, drunk, ebay, eco, explosion, fat, fixed, food, fuckwit, funny, future, games, gay, history, i want one, images, internet, iran, iraq, jesus, lesbian, literature, lucky, me, money, music, mystery, nano, NSFW, nuclear, obvious, oil, old, penis, piss, pr0n, quiz, randimg, religion, science, sex, shit, space, strange, stupid, taser, tech, terror, tits, torture, ugly, unlucky, vagina, video, war, wireless, wmd, wordpress, wtf?
-
E-Mail Subscription
- Enter your address:
-
Archives
- 2011: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2010: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2009: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2008: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2007: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2006: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2005: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
- 2004: Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
-
Pages
-
Static
-
Meta
