|
|
hippoface
regular
Reg'd: Sun
Posts: 2608
Loc: Shropshire
|
|
Hi
On the source of some websites it has <meta name = robots contents index follow>
other sites have <meta name = robots contents no index >
what are they for? and does a site need them?
Thanks
Jeff
If life seems jolly rotten,
There's something you've forgotten!
|
|
safeTsurfa
regular
Reg'd: Mon
Posts: 693
|
|
A site does not "need" them, but it is preferable to have them. Robots is the term used for the web bots/spiders that crawl web sites cataloguing them for the search engines. Using meta tags such as you cited instructs these spiders whether to index (add) the web page to their listing, and whether to follow links they find on that page.
The correct way to control this behaviour is to use a robots.txt file in the root folder, containing all the instructions about which spiders may or not crawl the site, about which folders and file types it may access or index. This can then be augmented by those meta tags to vary the general rules for individual pages.
Full details about controlling robots can be found at http://www.robotstxt.org/
safeTsurfa
Stay alert! Stay safe! Stay alive!
|
hippoface
regular
Reg'd: Sun
Posts: 2608
Loc: Shropshire
|
|
Hi
Cheers for that
So if on my site
I put <meta name ="Robots" content Index,no follow>in with the other meta tags
then the robots will only find that page and no other page.
I use frames in my site so when I view the source it tells me nothing except the site use frames
Jeff
If life seems jolly rotten,
There's something you've forgotten!
|
safeTsurfa
regular
Reg'd: Mon
Posts: 693
|
|
Almost correct. <meta name ="Robots" content Index,no follow> would tell the robot to index that page, but not follow any links the page contains. It would still pick up pages found from other links on the site which it got to without meeting that page, unless you add that meta tag to those pages too. This is where the robots.txt comes in handy for setting the main rules of engagement in the root folder.
Tip: to see the HTML coding on a web page using frames, avoid using "View source" from the menu, as that only shows the source of the parent page declaring the frameset variables. If you right click within the page itself instead, then select it from that menu, it will show the detailed source for that particular frame element.
safeTsurfa
Stay alert! Stay safe! Stay alive!
|
hippoface
regular
Reg'd: Sun
Posts: 2608
Loc: Shropshire
|
|
Thanks alot 
Jeff
If life seems jolly rotten,
There's something you've forgotten!
|
Previous
Index
Next
Threaded
Edit
Reply
Quote
