Wednesday, December 10, 2008
Spider Trap
A spider trap refers to either a continuous loop where spiders are requesting pages and the server is requesting data to render the page or an intentional scheme designed to identify (and "ban") spiders that do not respect robots.txt.
Labels:
sem hyderabad,
seo details,
seo hyderabad,
seo information,
seo notes
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment