6 lines
347 B
Plaintext
6 lines
347 B
Plaintext
Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
|
|
Mozilla/5.0 (compatible; Exabot/3.0 (BiggerBetter); +http://www.exabot.com/go/robot)
|
|
Mozilla/5.0 (compatible; Exabot/3.0; http://www.exabot.com/go/robot)
|
|
"GET /robots.txt HTTP/1.1" 404 287 "-" "Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)"
|
|
Exabot/2.0
|