Globrix.ie

Web Tools Technical guide What does the Globrix crawler do? What is it looking for?

What does the Globrix crawler do? What is it looking for?

Hits:
425
Rating:
 
Vote for this:
Good - Bad

Answer

Much like the crawling done by popular search engines such as Google and Yahoo, the Globrix crawler requests links from your website. It runs on a scheduled basis (usually daily) and requests pages that specifically list the properties. It then follows the links to each individual property page and collates just enough information in order to provide search results on Globrix. The crawler will only work if your site has an individual web page for each property.

Category