robots.txt

Status
Not open for further replies.

tommyboy123x

Daemon Poster
Messages
654
how do sites like webmasterworld configure the robots.txt (or other file) so that google does not cache it, but you can still read snippets of it in the google search?
 
i know how to set up a normal robots.txt file....

tommyboy123x said:
how do sites like webmasterworld configure the robots.txt (or other file) so that google does not cache it, but you can still read snippets of it in the google search?
 
Status
Not open for further replies.
Back
Top Bottom