Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

Coding Forum


You are currently viewing our Coding Forum as a guest. Please register to participate.
Login



Reply
Old 09-16-2005, 09:46 AM block search engines
Skilled Talker

Posts: 90
Location: Tokyo, Japan
Trades: 0
IS there code I can put into a page .. or a file that I could put into a directory which doesn't allow search engines to pick that page up. I have a certain directory on my homepage which would preferably be left alone by search engines and not be able to be searched...

Is that possible?
__________________
My site:
:::
Please login or register to view this content. Registration is FREE
vaio2006 is offline
Reply With Quote
View Public Profile Visit vaio2006's homepage!
 
 
Register now for full access!
Old 09-16-2005, 09:48 AM
Anacrusis's Avatar
Defies a Status

Posts: 2,099
Name: Adam
Location: Colchester CT
Trades: 0
yes it is... do a google search for "robots.txt" this is the file you will need to create in order to stop search engines from looking at certain directories and files. It's pretty simple to create and there is a ton of information about it.
Anacrusis is offline
Reply With Quote
View Public Profile
 
Old 09-17-2005, 04:20 AM
extermin8tor's Avatar
Super Talker

Posts: 129
Location: MARS!!
Trades: 0
yeh, thats what ya gotta do, edit the robots.tx. and add the command disallow to stuff you dont want it to see in your case the whole site.
__________________

Please login or register to view this content. Registration is FREE
The Light at the end of the tunnel just switched off!
extermin8tor is offline
Reply With Quote
View Public Profile
 
Old 09-17-2005, 08:22 AM
Minaki's Avatar
Defies a Status

Posts: 1,626
Location: Guildford, UK
Trades: 0
Remember that some rogue search engines (and other types of bots, ie spam bots) completely ignore the robots.txt file. The major ones (Google, Yahoo, MSN) obey it (I'm pretty sure they would anyway).

If you want to completely protect it, you'd need to either password protect it, or use one of those images that has obscured letters/numbers on it that the user has to type in.
__________________
Minaki Serinde MCP
"Wow, Linux is nearly on-par with Windows ME!"

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
Minaki is offline
Reply With Quote
View Public Profile Visit Minaki's homepage!
 
Reply     « Reply to block search engines
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 1.13299 seconds with 12 queries