17 lines
214 B
Plaintext
17 lines
214 B
Plaintext
User-agent: *
|
|
Allow: /
|
|
|
|
User-agent: Googlebot
|
|
Allow: /
|
|
|
|
User-agent: Googlebot-Image
|
|
Allow: /
|
|
|
|
User-agent: ia_archiver
|
|
Allow: /
|
|
|
|
User-agent: ia_archiver-web.archive.org
|
|
Allow: /
|
|
|
|
User-agent: archive.org_bot
|
|
Allow: / |