|
| "robots" metatag syntax to prevent crawling? |
 |
Fri, 8 Feb 2008 03:20:47 -0600 |
I'm trying to keep one of my published web pages "secret" and prevent
search
engines from finding/crawling it. What is the syntax or words I need to add
in the robots blank..?
Site view > Properties > 3rd tab- Meta Tag: robots
I know that I can upload a special robots.txt file to my host, but I only
want to block one specific page, not the whole site..
|
| Post Reply
|
| Re: "robots" metatag syntax to prevent crawling? |
 |
Fri, 8 Feb 2008 06:45:53 -0500 |
Sean,
In your robots.txt file, just put in something like this:
Disallow: /html/your_page.html
Disallow: your_page.html
-
Bert
"Sean" <local_host@fastmail.fm> wrote in message
news:foh6th$pv12@flsun90netnews01.netobjects.com...
> I'm trying to keep one of my published web pages "secret" and
prevent
> search engines from finding/crawling it. What is the syntax or words I
> need to add in the robots blank..?
>
> Site view > Properties > 3rd tab- Meta Tag: robots
>
> I know that I can upload a special robots.txt file to my host, but I only
> want to block one specific page, not the whole site..
>
|
| Post Reply
|
| Re: "robots" metatag syntax to prevent crawling? |
 |
Fri, 8 Feb 2008 07:06:30 -0500 |
Sean,
In answer to your original question, you could put this in your robots meta
tag on the page/s you do not want to index.
-
NOINDEX, NOFOLLOW
-
Bert
"Sean" <local_host@fastmail.fm> wrote in message
news:foh6th$pv12@flsun90netnews01.netobjects.com...
> I'm trying to keep one of my published web pages "secret" and
prevent
> search engines from finding/crawling it. What is the syntax or words I
> need to add in the robots blank..?
>
> Site view > Properties > 3rd tab- Meta Tag: robots
>
> I know that I can upload a special robots.txt file to my host, but I only
> want to block one specific page, not the whole site..
>
|
| Post Reply
|
| Re: "robots" metatag syntax to prevent crawling? |
 |
Fri, 8 Feb 2008 15:04:53 -0600 |
Bert, thanks.. Will it help to do both? Within NOF and upload robots.txt?
"TheBox" <nospam@this.com> wrote in message
news:fohgk9$s0k2@flsun90netnews01.netobjects.com...
> Sean,
>
> In answer to your original question, you could put this in your robots
> meta tag on the page/s you do not want to index.
> -
> NOINDEX, NOFOLLOW
> -
> Bert
>
> "Sean" <local_host@fastmail.fm> wrote in message
> news:foh6th$pv12@flsun90netnews01.netobjects.com...
>> I'm trying to keep one of my published web pages "secret" and
prevent
>> search engines from finding/crawling it. What is the syntax or words I
>> need to add in the robots blank..?
>>
>> Site view > Properties > 3rd tab- Meta Tag: robots
>>
>> I know that I can upload a special robots.txt file to my host, but I
only
>> want to block one specific page, not the whole site..
>>
>
>
|
| Post Reply
|
| Re: "robots" metatag syntax to prevent crawling? |
 |
Fri, 8 Feb 2008 16:32:44 -0500 |
It's up to you...if you just want to do a few pages...NOF is easiest; but if
you have a bunch of directories/folders you don't want the bots to crawl,
use the robots.txt method.
-
Bert
"Sean" <local_host@fastmail.fm> wrote in message
news:foig5m$19q2@flsun90netnews01.netobjects.com...
> Bert, thanks.. Will it help to do both? Within NOF and upload robots.txt?
>
>
>
>
>
> "TheBox" <nospam@this.com> wrote in message
> news:fohgk9$s0k2@flsun90netnews01.netobjects.com...
>> Sean,
>>
>> In answer to your original question, you could put this in your robots
>> meta tag on the page/s you do not want to index.
>> -
>> NOINDEX, NOFOLLOW
>> -
>> Bert
>>
>> "Sean" <local_host@fastmail.fm> wrote in message
>> news:foh6th$pv12@flsun90netnews01.netobjects.com...
>>> I'm trying to keep one of my published web pages "secret"
and prevent
>>> search engines from finding/crawling it. What is the syntax or
words I
>>> need to add in the robots blank..?
>>>
>>> Site view > Properties > 3rd tab- Meta Tag: robots
>>>
>>> I know that I can upload a special robots.txt file to my host, but
I
>>> only want to block one specific page, not the whole site..
>>>
>>
>>
>
>
|
| Post Reply
|
|
|
|
|
|
|
|
|
|