REGISTER
|
Search Tycoon Talk
|
Freelancer.com
|
Members
Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.
Register Here
Forum Rules
The Other Search Engines
You are currently viewing our The Other Search Engines as a guest. Please
register
to participate.
Login
Remember Me?
Login via Freelancer.com
Tycoon Talk
>
Search Engine Tycoon
>
The Other Search Engines
>
how how do I prevent my site from geting spidered?
Link Back
Thread Tools
Search this Thread
how how do I prevent my site from geting spidered?
08-25-2004, 01:38 AM
#
1
(
permalink
)
how how do I prevent my site from geting spidered?
samson
Registered User
Posts: 107
Location: Victoria, BC
Trades:
0
Talkupation:
User-agent: *
Disallow: /
will that work?? Is there some other preventions?
basically, I want my entire site to be unspiderable.
Register
now for full access!
08-25-2004, 09:17 AM
#
2
(
permalink
)
Anacrusis
Defies a Status
Posts: 2,099
Name: Adam
Location: Colchester CT
Trades:
0
Talkupation:
That should work, if the spider obeys the robots.txt file. You should be ok if you have that and don't submit your site to any directories or anything.
09-05-2004, 11:14 PM
#
3
(
permalink
)
vivekar
Webmaster Talker
Posts: 612
Trades:
0
Talkupation:
Make your website password protected.
Use a nice authentication system.
On the home page, you can inform the human visitors to use a username and password.
Try using
Website Guard
. Your server should be able to run PHP.
Just my 2cents.
__________________
Please login or register to view this content.
Registration is FREE
(Active since 2003) |
Please login or register to view this content.
Registration is FREE
Last edited by vivekar; 09-05-2004 at
11:20 PM
..
« Reply to
how how do I prevent my site from geting spidered?
Previous Thread
|
Next Thread
Tycoon Talk
>
Search Engine Tycoon
>
The Other Search Engines
>
how how do I prevent my site from geting spidered?
Thread Tools
Search this Thread
Show Printable Version
Email this Page
Search this Thread
:
Advanced Search
Posting Rules
You
may not
post new threads
You
may not
post replies
You
may not
post attachments
You
may not
edit your posts
BB code
is
On
Smilies
are
On
[IMG]
code is
Off
HTML code is
Off
Trackbacks
are
Off
Pingbacks
are
Off
Refbacks
are
Off
Forum Rules
Feeds:
RSS
JS
XML
Feeds for this forum:
RSS
JS
XML
LinkBack
LinkBack URL
About LinkBacks
Bookmark & Share
Digg this Thread!
Add Thread to del.icio.us
Bookmark in Technorati
Tweet this thread
Page generated in
0.37752
seconds with
12
queries