Twitter's robots.txt question:

Hemat

Beta member
Messages
1
[FONT=&quot]Twitter's robots.txt, It shows everything is disallowed, but surprisingly search engines are crawling and indexing everybody's profiles pages, Why?[/FONT]
 
Top