Sock puppetry has finally made this forum almost totally useless as a discussion platform. Welcome!

Can a bot search a site set up with HTACCESS username/password?

I put together a site for my daughter's class so people can have access to all the usual stuff that gets misplaced (yearly calendar, reminders, blah blah blah).

Setting up HTACCESS with username/password was easy enough through my hosting company. I simply flipped the on switch and defined which root folder (and thereby all subfolders) to secure.

Feedback has been positive. But a few folks are concerned that their personal information (i.e. phone number & email) will be found by search engine bots.

Can search engine bots crawl and serve up folders & pages locked down by htaccess? If so, is there a way to create the .htaccess file to restrict bot access? Does anyone have any better way to do this with something other than .htaccess?
Permalink Curious George 
January 6th, 2006
Oops, you found an error!