Did you ever wonder which Search Engines were spidering your pages? This script tracks several spiders and logs their actions to a mysql database.
This script will generate a report in log file & give you a detailed analysis of search engine spiders activities & which of your webpages are indexed by search engines & which are not. What more, this script is free to download, install and use.