Active search engines with own crawler and database at 12/12/2010:

Search engine URL search engine Bot/crawler URL bot/crawl help URL add/sumit website Result keyword "copyright" Result keyword "majesticseo"
Yahoo http://search.yahoo.com Slurp http://help.yahoo.com/help/us/ysearch/slurp http://siteexplorer.search.yahoo.com/submit 83,000,000 4,350
  http://nl.yahoo.com       26,600,000,000 25,200
  http://fr.yahoo.com       25,900,000,000 25,100
  http://uk.yahoo.com       25,900,000,000 24,800
Google http://www.google.com Googlebot http://www.google.com/bot.html http://www.google.com/addurl/?continue=/addurl 2,660,000,000 17,400
  http://www.google.nl       2,640,000,000 17,300
  http://www.google.be       2,670,000,000 17,400
  http://www.google.fr       2,680,000,000 17,300
  http://www.google.co.uk       2,750,000,000 17,400
Bing http://www.bing.com bingbot http://www.bing.com/bingbot.htm http://www.bing.com/webmaster/SubmitSitePage.aspx 88,000,000 4,660
  http://www.bing.com/?cc=nl msnbot http://search.msn.com/msnbot.htm   86,600,000 4,660
  http://www.bing.com/?cc=be       86,500,000 4,920
  http://www.bing.com/?cc=fr       28,700,000 4,480
  http://www.bing.com/?cc=gb       93,800,000 17,700,00
Exalead http://www.exalead.com/search/ Exabot http://www.exabot.com/go/robot http://www.exalead.com/search/web/submit/ 1,709,495,598 1,882
  http://www.exalead.fr/search/       1,709,495,598 1,882
Teoma http://www.teoma.com Ask Jeeves/Teoma http://about.ask.com/en/docs/about/webmasters.shtml http://about.ask.com/en/docs/about/webmasters.shtml#18 1,320,000,000 4,580
Ask http://us.ask.com Ask Jeeves/Teoma http://about.ask.com/en/docs/about/webmasters.shtml http://about.ask.com/en/docs/about/webmasters.shtml#18 - -
  http://nl.ask.com       254,050,000 509
  http://fr.ask.com       255,570,000 518
  http://uk.ask.com       1,040,000,000 4,570
Goo http://search.goo.ne.jp ichiro http://help.goo.ne.jp/help/article/704/ http://addurl.goo.ne.jp/mobile/ 1,310,000,000 12,000
Gogo http://go.mail.ru Mail.Ru http://go.mail.ru/help_robots.html http://go.mail.ru/addurl 1,220,000,000 4,290
Rambler http://nova.rambler.ru/search StackRambler http://help.rambler.ru/article.html?id=327&s=221 http://robot.rambler.ru/cgi-bin/addsite.cgi 438,000,000 488
Blekko http://blekko.com ScoutJet http://www.scoutjet.com - 266,000,000 2,000
Gigablast http://www.gigablast.com Gigabot http://www.gigablast.com/spider.html http://www.gigablast.com/addurl 266,621,632 557
Naver http://web.search.naver.com/search.naver Yeti http://help.naver.com/robots - 319,553,692 24
Become http://www.become.com BecomeBot http://discoverourtown.become.com/site_owners.html - 152,147,217 19
Yandex http://www.yandex.com Yandex http://yandex.com/bots - 191,000,000 2,120
Baidu http://www.baidu.com Baiduspider http://www.baidu.com/search/spider.htm http://www.baidu.com/search/url_submit.html 100,000,000 2,120
Seznam http://search.seznam.cz SeznamBot http://fulltext.sblog.cz/robot/ http://search.seznam.cz/pridej-stranku 88,409,667 34
Gais http://gais.cs.ccu.edu.tw Gaisbot robot06@gais.cs.ccu.edu.tw - 77,126,658 0
Voila http://search.ke.voila.fr VoilaBot support.voilabot@orange-ftgroup.com - 1,790,000,001 3,871
Entireweb http://www.entireweb.com Speedy Spider http://www.entireweb.com/about/search_tech/speedy_spider http://www.entireweb.com/free_submission/ 49,800,000 561
Daum http://ws.daum.net Daumoa http://ws.daum.net/aboutWebSearch.html - 64,783,317 160
Kobala http://www.kobala.nl Vagabondo http://webagent.wise-guys.nl - - -
  http://www.kobala.be       - -
Botje http://www.botje.com Plukkie http://www.botje.com/plukkie.htm http://85.17.171.225/searchall/addurl.aspx 11,165,556 86
  http://www.botje.nl       24,593,839 105
  http://www.botje.be       7,724,121 31
  http://www.botje.fr       8,208,232 39
  http://www.botje.co.uk       12,290,490 26
Sogou http://www.sogou.com Sogou web spider http://www.sogou.com/docs/help/webmasters.htm#07 http://www.sogou.com/feedback/urlfeedback.php 11,923,979 277
Mojeek http://www.mojeek.com MojeekBot http://www.mojeek.com/bot.html http://www.mojeek.com/addurl 22,187,817 202
  http://www.mojeek.co.uk       22,187,817 202
Ayell http://www.ayell.eu Eurobot http://eurobot.ayell.eu http://www.ayell.de/url/add/type/simple 21,071,809 40
  http://www.ayell.nl       - -
  http://www.ayell.be       - -
  http://www.ayell.co.uk       21,071,809 40
Guruji http://www.guruji.com GurujiBot http://www.guruji.com/en/WebmasterFAQ.html http://dir.guruji.com/misc/SubmitSite.php 16,560,861 1,981
Jyxo http://jyxo.vybereme.cz Jyxobot - http://jyxo.vybereme.cz/d/submit 14,203,920 129
Webwombat http://www.webwombat.com.au www.webwombat.com.au - http://www.webwombat.com.au/submit/index.htm 9,369,477 1
Setooz http://nl.setooz.com SETOOZBOT http://www.setooz.com/oozbot.html - 704,600 32,700
Zscho http://www.zscho.de/en/ Zscho.de http://zscho.de/de/bot.html http://www.zscho.de/submit_page.jsp - -
Acoon http://www.acoon.com Acoon Robot - http://www.acoon.de/addurl.asp - 2
Soso http://www.soso.com Sosospider http://help.soso.com/webspider.htm http://www.soso.com/help/usb/urlsubmit.shtml 6,180,000 817
Iltrovatore http://www.iltrovatore.it Iltrovatore-Setaccio http://www.iltrovatore.it/bot.html - 4,514,370 0
Abacho http://www.abacho.com AbachoBOT   http://www.abacho.de/url-anmeldung/ - -
http://www.abacho.co.uk - -
Wotbox http://www.wotbox.com Wotbox bot@wotbox.com http://www.wotbox.com/addurl 281,917 0
  http://fr.wotbox.com       - -
  http://www.wotbox.co.uk       - -
Amfibi http://www.amfibi.com Cabot http://www.amfibi.com/cabot/ http://www.amfibi.com/addurl/ 1,370,933 2
Walhello http://www.walhello.info appie - http://www.walhello.com/addlinkgl.html 186,492 3
Yacy http://www.yacy.de yacybot http://yacy.net/bot.html - 227,139 0
Yioop http://www.yioop.com YioopBot http://www.yioop.com/bot.php - 436,876 0
Youdao http://www.youdao.com YoudaoBot http://www.youdao.com/help/webmaster/spider http://tellbot.youdao.com/report?keyFrom=help 67,500 185
Zhongsou http://www.zhongsou.com - - http://ads.zhongsou.com/register/page.jsp 48,400,000 0

Not active any more or domain active but bought and use other crawler/database or changed in meta search engine at 12/12/2010:

Cuil http://www.cuil.com Twiceler http://www.cuil.com/twiceler/robot.html Stopped 9/10/2010 out of money  
Searchme http://www.searchme.com Charlotte http://www.searchme.com/support/ Stopped 07/24/2009 out of money    
Wisenut http://www.wisenut.com ZyBorg http://www.wisenutbot.com Stopped 09/28/2007 3/12/2002 bought by Looksmart $9.25mln all-stocks deal    
Accoona http://www.accoona.com Accoona-AI-Agent aicrawler at accoonabot dot com Stopped 10/2008 11/5/2008 bought by Masterseek    
Openfind http://www.openfind.com Openbot robot-response@openfind.com.tw Stopped started search for companies    
Sproose http://www.sproose.com sproose http://www.sproose.com/bot.html Stopped started recommendation engine at same domain  
Majestic12 http://search.majestic12.co.uk MJ12bot http://majestic12.co.uk/bot.php Stopped started search for SEO http://www.majesticseo.com    
Wikia http://search.wikia.com wikia-robot Stopped 5/14/2009  
Boitho http://www.boitho.com boitho.com-dc http://www.boitho.com/dcbot.html Stopped started search for companies http://www.searchdaimon.com    
Mozdex http://www.mozdex.com mozDex http://www.mozdex.com/bot.html Down    
Euroseek http://www.euroseek.com Arachnoidea arachnoidea@euroseek.com Stopped 11/2001 out of money bought by WorldLight now later renamed to Entireweb    
Ilse http://www.ilse.nl INGRID http://webmaster.ilse.nl/jsp/webmaster.jsp Use Google?    
Vindex http://www.vindex.nl Use Google?  
Fireball http://www.fireball.de Firefly   Use Google?    
Tricus http://www.tricus.com BlitzBOT BlitzBOT@tricus.net Stopped started Cogisum Intermedia search for companies http://www.cogia.de    
OsO http://oso.octopodus.com OsO http://oso.octopodus.com/abot.html Down    
Altavista http://www.altavista.com Scooter   02/20/2003 bought by Overture from Digital Equipment
 for $140mln cash and stock
   
Alltheweb http://www.alltheweb.com FAST-WebCrawler http://fast.no/support/crawler.asp 02/25/2003 bought by Overture from Fast for 530mln Norway Kroner  
Lycos http://www.lycos.com Lycos_Spider   08/18/2010 bought by Ybrant digital from Daum communications for $36mln    
Hotbot http://www.hotbot.com Slurp http://www.inktomi.com/slurp.html 12/23/2002 bought by Yahoo from Inktomi for $235mln    
Excite http://www.excite.com ArchitextSpider   01/19/1999 bought by Home Network    
Infoseek http://www.infoseek.com Infoseek Sidewinder   1998 bought by Wall Disney    
Go http://go.com Disney redirect to Yahoo  
Iask http://www.iask.com iaskspider http://iask.com/help/help_index.html Sina.com redirect to Google    
Webcrawler http://www.webcrawler.com WebCrawler Bought by Excite  
Northern Light http://www.northernlight.com Gulliver   Stopped 01/16/2002 out of money    

Index

Copyright 1996-2011, PCplein
info@pcplein.nl