nocko

Is there any way to prevent a spider from grabbing URLs that you want to keep off search engines?

thanks......
__________________
indoor fountains georgia fha mortgage

acuzine

I'm into that problem too. Calling somebody's attention who has the knowledge about it. We both need help please. Need answers soon.

__________________
compatible toner cartridge Mercedes Leasing

paul.e

You can put the directory/folder of the files you don't want to be crawled by google in robots.txt file. Here's how to use robots txt file - How do I use a robots.txt file to control access to my site?

jane

Or you can put a "nofollow, noindex" tag in the link.

azeemi

hi there,
Upload robot.txt file on your server.
The robots.txt file is a set of instructions to tell the various search engine spiders not to crawl or index certain sections or pages of your site. You can use it to prevent indexing totally, prevent certain areas of your site from being indexes or to issue individual indexing instructions to specific search engines.

There is nothing difficult about creating a basic robots.txt file. It can be created using notepad or whatever is your favorite text editor. Each entry has just two lines:

Example:

User-Agent: [Spider or Bot name]
Disallow: [Directory or File Name]

thanks.

__________________
Architecural Visualization
UK Search Engine Optimization Company