Forum Posters Union - Spiders, Crawlers and web robots http://www.forumpostersunion.com Intelligence on search engine spider bots and identification, bad bots from spam botnets, content scrapers, tools to identify web robots, blocking malicious bots. en Fri, 10 Sep 2010 19:16:30 GMT vBulletin 60 http://www.forumpostersunion.com/images/misc/rss.jpg Forum Posters Union - Spiders, Crawlers and web robots http://www.forumpostersunion.com X4d Backlinkchecker web robot http://www.forumpostersunion.com/showthread.php?t=14804&goto=newpost Sat, 04 Sep 2010 21:36:35 GMT *04:20 PM Guest Viewing Member List 85.214.19.188 findashop.de X4d Backlinkchecker * *No idea why this bot was scanning our member list,... 04:20 PM Guest Viewing Member List
85.214.19.188 findashop.de
X4d Backlinkchecker

No idea why this bot was scanning our member list, could be another one of those poorly programmed SEO analysis bots !!!

PS: No link back to a web crawler or spider ID page in the user agent = BANNED !!


IP Location: Germany Berlin Strato Rechenzentrum Berlin

Resolve Host: findashop.de

IP Address: 85.214.19.188
Reverse IP: 88 websites use this address. (examples: 3d-full-hd.net 3d-projektor.net 50plus-blog.net anbaubalkon-info.de)

inetnum: 85.214.16.0 - 85.214.139.255
netname: STRATO-RZG-DED2
descr: Strato Rechenzentrum, Berlin
country: DE
admin-c: SRDS-RIPE
tech-c: SRDS-RIPE
remarks: ************************************************** **********
remarks: * Please send abuse complaints to *
remarks: * or fax +49-30-88615-755 ONLY. *
remarks: * Abuse reports to other e-mail addresses will be ignored. *
remarks: ************************************************** **********
status: ASSIGNED PA
mnt-by: STRATO-RZG-MNT
source: RIPE # Filtered

role: RIPE contact Strato Rechenzentrum AG Dedicated Server
address: Strato Rechenzentrum AG
address: Pascalstr. 10
address: D-10587 Berlin
address: Germany
phone: +49 30 39802-0
abuse-mailbox:
admin-c: XX1-RIPE
tech-c: WB14-RIPE
tech-c: CHSE-RIPE
nic-hdl: SRDS-RIPE
remarks: ************************************************** **********
remarks: * Please send abuse complaints to *
remarks: * or fax +49-30-88615-755 ONLY. *
remarks: * Abuse reports to other e-mail addresses will be ignored. *
remarks: * *
remarks: * For peering requests or operational issues please look *
remarks: * at the information in the AS6724 RIPE database object. *
remarks: ************************************************** **********
mnt-by: STRATO-RZG-MNT
source: RIPE # Filtered

route: 85.214.0.0/16
descr: Strato Rechenzentrum
origin: AS6724
mnt-by: STRATO-RZG-MNT
source: RIPE # Filtered

route: 85.214.0.0/15
descr: Strato Rechenzentrum
origin: AS6724
mnt-by: STRATO-RZG-MNT
source: RIPE # Filtered ]]> Spiders, Crawlers and web robots AnthonyCea http://www.forumpostersunion.com/showthread.php?t=14804 atraxbot/0.3 http://www.forumpostersunion.com/showthread.php?t=14737&goto=newpost Thu, 02 Sep 2010 21:55:58 GMT *04:42 PM Guest Viewing Thread 174.46.170.173 Atrax Solutions atraxbot/0.3; http://www.atraxsolutions.com/atraxbot* IP Location: United... 04:42 PM Guest Viewing Thread
174.46.170.173
Atrax Solutions atraxbot/0.3; http://www.atraxsolutions.com/atraxbot

IP Location: United States Kansas City Tw Telecom Holdings Inc

IP Address: 174.46.170.173

NetRange: 174.46.0.0 - 174.47.255.255
CIDR: 174.46.0.0/15
OriginAS:
NetName: TWTC-NETBLK-17
NetHandle: NET-174-46-0-0-1
Parent: NET-174-0-0-0-0
NetType: Direct Allocation
NameServer: NS1.TWTELECOM.NET
NameServer: NS2.TWTELECOM.NET
RegDate: 2009-01-14
Updated: 2009-01-14
Ref: http://whois.arin.net/rest/net/NET-174-46-0-0-1

OrgName: tw telecom holdings, inc.
OrgId: TWTC
Address: 10475 Park Meadows Drive
City: Littleton
StateProv: CO
PostalCode: 80124
Country: US
RegDate: 1999-03-17
Updated: 2008-07-01
Ref: http://whois.arin.net/rest/org/TWTC

ReferralServer: rwhois://rwhois.twtelecom.net:4321

OrgAbuseHandle: TWTAD-ARIN
OrgAbuseName: tw telecom Abuse Desk
OrgAbusePhone: +1-800-898-6473
OrgAbuseEmail:
OrgAbuseRef: http://whois.arin.net/rest/poc/TWTAD-ARIN

OrgTechHandle: NST12-ARIN
OrgTechName: NOC SWIP Team
OrgTechPhone: +1-800-898-6473
OrgTechEmail:
OrgTechRef: http://whois.arin.net/rest/poc/NST12-ARIN

OrgNOCHandle: TDN1-ARIN
OrgNOCName: TWTC Data NOC
OrgNOCPhone: +1-800-898-6473
OrgNOCEmail:
OrgNOCRef: http://whois.arin.net/rest/poc/TDN1-ARIN

RAbuseHandle: TWTAD-ARIN
RAbuseName: tw telecom Abuse Desk
RAbusePhone: +1-800-898-6473
RAbuseEmail:
RAbuseRef: http://whois.arin.net/rest/poc/TWTAD-ARIN

RTechHandle: ZT87-ARIN
RTechName: IP Manager
RTechPhone: +1-800-829-0420
RTechEmail:
RTechRef: http://whois.arin.net/rest/poc/ZT87-ARIN

RNOCHandle: TDN1-ARIN
RNOCName: TWTC Data NOC
RNOCPhone: +1-800-898-6473
RNOCEmail:
RNOCRef: http://whois.arin.net/rest/poc/TDN1-ARIN

== Additional Information From rwhois://rwhois.twtelecom.net:4321 ==

network:Class-Name:network
network:ID:9b636318-34c1-11de-a5e8-0015c5e45005
network:Auth-Area:174.46.0.0/15
network:Network-Name:GlobalEntity-174-46-170-160
network:IP-Network:174.46.170.160/27
network:Organization;I:425c8fde-34c0-11de-aa55-0015c5e45005
network:Org-Name:nXn TECH
network:Street-Address:8300 NORMAN CENTER DR
network:City:BLOOMINGTON
network:State:MN
network:Postal-Code:55437
network:Country-Code:us
network:Phone:none
network:Admin-Contact;I:none
network:Tech-Contact;I:none
network:Abuse-Contact;I:
network:Updated:20090429070429000 ]]> Spiders, Crawlers and web robots AnthonyCea http://www.forumpostersunion.com/showthread.php?t=14737 DoCoMo/1.0/D209i user agent? http://www.forumpostersunion.com/showthread.php?t=14646&goto=newpost Sun, 29 Aug 2010 15:00:07 GMT I did a search on this useragent but came up with nothing definite; DoCoMo/1.0/D209i The IP for the one hit today is 200.223.17.114 Can anyone... I did a search on this useragent but came up with nothing definite;

DoCoMo/1.0/D209i

The IP for the one hit today is 200.223.17.114

Can anyone shed some light on this one please? ]]> Spiders, Crawlers and web robots wingnut1 http://www.forumpostersunion.com/showthread.php?t=14646 Hailoobot/1.2 http://www.forumpostersunion.com/showthread.php?t=14476&goto=newpost Fri, 20 Aug 2010 22:22:10 GMT 05:03 PM Guest Viewing Index 38.125.95.250 Mozilla/5.0 (compatible; Hailoobot/1.2; +http://www.hailoo.com/spider.html) ---Quote--- Web... 05:03 PM Guest Viewing Index
38.125.95.250
Mozilla/5.0 (compatible; Hailoobot/1.2; +http://www.hailoo.com/spider.html)

Quote:
Web Crawling
Like most Internet search engines, Hailoo is essentially an enormous index of the Internet. In order to create this index, Hailoo sends out "web crawlers" to explore and download interesting websites. A "web crawler," also known as a web spider or robot, is a computer program which visits websites and extracts links from each page in order to find more pages to download. Each page is then added to Hailoo's index so that it can potentially appear in a search result.

Unlike other Internet search engines, Hailoo focuses specifically on the Arabic portion of the web. Hailoo currently fetches more Arabic pages than any existing search engine. Our web crawlers are designed to specifically seek out Arabic web pages, or web pages which may be interesting to Middle Easterners or Arabic-speaking people.
]]> Spiders, Crawlers and web robots AnthonyCea http://www.forumpostersunion.com/showthread.php?t=14476 goblox Bot Search http://www.forumpostersunion.com/showthread.php?t=14407&goto=newpost Wed, 18 Aug 2010 04:09:57 GMT *173.242.114.45 server2.web-leader.net goblox Bot Search * No idea what these guys are doing, but since they are running an unidentified bot (no... 173.242.114.45 server2.web-leader.net
goblox Bot Search

No idea what these guys are doing, but since they are running an unidentified bot (no link back to a spider identification page in user agent) they are banned. ]]> Spiders, Crawlers and web robots AnthonyCea http://www.forumpostersunion.com/showthread.php?t=14407