RE: Demo of Sputnik with LuaUsers content
[
Date Prev][
Date Next][
Thread Prev][
Thread Next]
[
Date Index]
[
Thread Index]
- Subject: RE: Demo of Sputnik with LuaUsers content
- From: "Jerome Vuarand" <jerome.vuarand@...>
- Date: 2008年2月21日 19:53:07 -0500
Miles Bader wrote:
> "Jerome Vuarand" <jerome.vuarand@ubisoft.com> writes:
>>>> However, as with robots.txt, Google honors noindex strictly when it
>>>> feels like it.
>>>
>>> What make you think that?
>>
>> I personnally have a blog with a robots.txt disallowing the whole
>> domain, and still Google kept some links to it. I had to manually
>> remove them in the Google webmaster console.
>
> Did the links predate the robots.txt file being added? I wouldn't be
> surprised if google handled robots.txt simply by having their crawler
> abort when it saw it, so the effects wouldn't be retroactive.
No, I anticipated that possibility and I placed the robots.txt file long
before any content.