Saturday, May 30, 2009

Free Surf 32

Why BOT BOT is BAD BAD for your website

bot@bot.bot. Weird creature, weird name. If you are a webmaster or just a web site owner most likely you already heard about internet bots. You also know that there are bad bots and good bots. For example, Google or Yahoo is using bots to crawl your site and place your pages at the top of search pages (SERP). These are very good bots. OK, not always at the top. But still these bots are not so bad. And, surely, when you'll see bot@bot.bot you'll wonder what is this bot good for. Or BAD for.

Bandwidth wasting could be a problem, but since internet and its technologies evolve this tends to not be anymore the most stringent problem. However, some server overload can be accused. SPAM is another bad goal of certain bots, but this may not affect your site directly. So, which is the bot@bot.bot business?

Our software engineers trapped bot@bot.bot, IP: 71.13.115.117 - bot/1.0 (bot; http://; bot@bot.bot) and studied its behavior. And this is what they discovered: bot@bot.bot is stealing your website! Right, this bot is stealing content from your web site to create so-called 'doorway pages' - fake web pages using text from your site and from other sites, with the only purpose to rank well in SERP and then to redirect the visitors to various black or white business of the bot owners.

What does this mean? Either you are an internet software publisher or e-commerce site owner this means stolen places in the search results page, because these pages usually being optimized for search engines will rank at the top, stolen visitors and less customers.

Even though Google, Yahoo and other search engines will penalize these black SEO practices, it may take a long term (very long term) until the uncovering and action, so you cannot count on this. You must take action and block bad bots like bot@bot.bot - bot/1.0 (bot; http://; bot@bot.bot) IP: 71.13.115.117, otherwise your finances will go down.

That's why it's not enough to say bot@bot.bot is bad. BOT BOT is BAD BAD.

User Agent: bot/1.0 (bot; http://; bot@bot.bot) IP: 71.13.115.117


More about Doorway pages or How to block bad bots will come in the SoftSpecialist next articles. Until next time Keep Safe! Safe software and safe websites.

No comments:

Post a Comment