Posts Tagged ‘search engine optimization’

Getting Inside Your Robots.txt File

August 5th, 2012 Leave a comment
Getting Inside Your Robots.txt File

For most people, the web site is a collection of sites that are posted online for hobbies, work, amusement or business. When we want to find a site on a particular topic we open up our favorite search engine and with a few keywords, find what we need. For some, little thought is given to how those pages get linked to those keywords. How does the search engine know that this page is about this topic? How does it know two pages are related through links? The simple answer is the Robots.txt file that is used to inform search… View full post »