Needed - Controlled Crawling Help

[padthaiforlunch]

Just tried Godaddy's search engine visibility tool. Among the things I need to fix is this:

Controlled Crawling
It's important that search engine spiders find your robots.txt file that guides spiders to pages and directories you want crawled and denies entry to protected areas of your site.
[FONT=Arial,Helvetica,sans-serif]Look out! You have robots.txt file issues.[/FONT]
No robots.txt file found

Can someone here please provide some html code that I can copy and paste onto my website along with instructions on where to place the code on the page?

Thanks!

 

[somarco]

robots.txt goes in your root directory, not on a page.

Block or remove pages using a robots.txt file - Webmaster Tools Help

 

[padthaiforlunch]

Thanks for the link. I'm not looking to block any part of my site from being crawled. My understanding is robot.txt file will block the crawl. Or is there a welcome robot that invites the search engine spiders to visit?

 

[somarco]

Your sitemap is the "welcome" invite.

 

[YouGotMyMoney]

the robots.txt file tells bots what they can crawl, if you have page/sub domains you don't want indexed you can put that in the robots.txt file.