-

- ( )
: 8660 : 31
-
: 4328 : 16
, " "
: 42340 : 9

 -

 - -

musie cat princess

moody blue
1

 -

   goldmetel

 - e-mail

 

 -

 LiveInternet.ru:
: 20.03.2010
: 1940
: 16312
: 25906

:

" ":
1 - Robots txt!
2 - ... !

.


: (233), (30), (249), (150), (10), (30), (80), (1), (11), (40), - Universe(40), (47), ?(64), (19), (49), (12), !(10), (7), (9), (1), www - net(30), www - net(137), Windows(17), web-design(76), Underground(7), twitter(13), Sex(6), SEO(27), on-line(3), Music(324), Li(21), Dance(9), 60-(16)
(2)

Robots txt!

, 30 2011 . 15:00 +

: , , , .

WWW - robots.txt.

- . - , .

? : , .

robots.txt , 1994 . robots.txt . robots.txt – The Robots Exclusion Protocol, . Robots.txt sitemap.xml: robots.txt , sitemap.xml – . robots.txt – , - , robots.txt, robots.txt – Disallow.

robots.txt – www.robotstxt.org ( ) robotstxt.org.ru.

   robots.txt . robots.txt . , ( ), SEO- : , , robots.txt.
 

robots.txt

robots.txt. HTML- XML-, robots.txt - , – .

, robots.txt – Disallow. , , User-agent: ‘*’. , – . :

User-agent: * Disallow: /
( ),

, :

User-agent: Yandex
Allow: /cgi-bin
Disallow: /

– , , ‘/cgi-bin’.

, , User-agent . , –

User-agent: Yandex
Disallow: /
Allow: /cgi-bin




 

: .



 

 


:  
(14)

... !

, 07 2012 . 12:29 +

,

 

-, .

« ». , . - « » ". ,

. 2000—3000 , . , . , , .

-, .

 — 70% . , . .

-, .

, - . , , . - 2-3 .

-, .
 

, , . .  — . , - , - , , .

. . . . 2000 1-2 .

-, , .

, . , .

!

SEO

:  

 : [1]