تقييمات الطلاب
( 5 من 5 )
١ تقييمات
فيديو شرح Crawl Optimization: Tracking and Monitoring Bots - ecommerce SEO: 10-hour course ضمن كورس اساسيات تحسين محركات البحث (السيو) شرح قناة Traian Neacsu، الفديو رقم 8 مجانى معتمد اونلاين
Googlebot, Yahoo! Slurp, and Bingbot are polite bots, which means that they will first obey the crawling directives found in robots.txt files, before requesting resources from your website. Polite bots will identify themselves to the web server, so you can control them as you wish. The requests made by bots are stored in your log files and are available for analysis.
Webmaster tools, such as the ones provided by Google and Bing, only uncover a small part of what bots do on your website—e.g., how many pages they crawl or bandwidth usage data. That is useful in some ways but is not enough.