Tycoon Talk
Become a Big fish!
The number 1 forum for online business!
Post topics, ask questions, share your knowledge.
Tycoon Talk is part of Freelancer.com - find skilled workers online at a fraction of the cost.

SEO Tycoon


You are currently viewing our SEO Tycoon as a guest. Please register to participate.
Login



Freelance Jobs

Reply
Quick yes/no question
Old 02-05-2009, 08:07 AM Quick yes/no question
magicvw's Avatar
Extreme Talker

Posts: 233
Name: Vicky
Location: Brit in Bulgaria
Trades: 1
If I have a password protected directory can the spiders index it? I haven't stopped them in my robots txt, so are they allowed in? thnx
__________________

Please login or register to view this content. Registration is FREE



Please login or register to view this content. Registration is FREE
magicvw is offline
Reply With Quote
View Public Profile Visit magicvw's homepage!
 
 
Register now for full access!
Old 02-05-2009, 08:09 AM Re: Quick yes/no question
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
No ....
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 02-05-2009, 08:10 AM Re: Quick yes/no question
magicvw's Avatar
Extreme Talker

Posts: 233
Name: Vicky
Location: Brit in Bulgaria
Trades: 1
ok thanks!
__________________

Please login or register to view this content. Registration is FREE



Please login or register to view this content. Registration is FREE
magicvw is offline
Reply With Quote
View Public Profile Visit magicvw's homepage!
 
Old 02-05-2009, 09:34 PM Re: Quick yes/no question
SEO Specialist

Posts: 989
Trades: 0
why no? Just confuse!I wanna know.
__________________
best-selling brands of
Please login or register to view this content. Registration is FREE
and
Please login or register to view this content. Registration is FREE
full house is offline
Reply With Quote
View Public Profile Visit full house's homepage!
 
Old 02-05-2009, 10:01 PM Re: Quick yes/no question
Defies a Status

Posts: 1,605
Trades: 0
Quote:
Originally Posted by full house View Post
why no? Just confuse!I wanna know.

Because they don't have the username or password.
__________________
Colbyt

Please login or register to view this content. Registration is FREE
colbyt is offline
Reply With Quote
View Public Profile
 
Old 02-06-2009, 02:41 AM Re: Quick yes/no question
francis84's Avatar
Super Spam Talker

Posts: 931
Trades: 0
As far as I know, NO. Website with Password Protection make the spiderbot find it hard to crawl (or should I say, NOT TO BE CRAWL) by spiderbot.
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
francis84 is offline
Reply With Quote
View Public Profile Visit francis84's homepage!
 
Old 02-10-2009, 12:02 AM Re: Quick yes/no question
Novice Talker

Posts: 5
Trades: 0
absolutely NO
__________________

Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE


Please login or register to view this content. Registration is FREE
CoolDude55 is offline
Reply With Quote
View Public Profile
 
Old 02-10-2009, 11:10 AM Re: Quick yes/no question
Junior Talker

Posts: 2
Name: Tsvetan
Trades: 0
spiders act like visitors in the way they access a website so it is not possible to crawl a password protected website
__________________

Please login or register to view this content. Registration is FREE
vetzkov is offline
Reply With Quote
View Public Profile
 
Old 02-11-2009, 09:08 PM Re: Quick yes/no question
SEO Specialist

Posts: 989
Trades: 0
are you saying those site with username and password like wordpress, blogger and others?
__________________
best-selling brands of
Please login or register to view this content. Registration is FREE
and
Please login or register to view this content. Registration is FREE
full house is offline
Reply With Quote
View Public Profile Visit full house's homepage!
 
Old 02-11-2009, 10:09 PM Re: Quick yes/no question
Moxxnixx's Avatar
King Spam Talker

Posts: 1,174
Name: Lance
Location: Virginia Beach
Trades: 0
Excuse my ignorance...
Sometimes, when doing a search on Google, I'll click a link and I won't see the page because I have to login to see it...like a forum, for example. How is Google indexing those if they're password protected?
__________________
Get your facts first, and then you can distort them as much as you please. - Mark Twain

Please login or register to view this content. Registration is FREE
---

Please login or register to view this content. Registration is FREE

All My Sites Are Proudly Hosted @
Please login or register to view this content. Registration is FREE

Moxxnixx is offline
Reply With Quote
View Public Profile Visit Moxxnixx's homepage!
 
Old 02-12-2009, 09:36 PM Re: Quick yes/no question
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Quote:
Originally Posted by Moxxnixx View Post
Excuse my ignorance...
Sometimes, when doing a search on Google, I'll click a link and I won't see the page because I have to login to see it...like a forum, for example. How is Google indexing those if they're password protected?
There are ways of allowing SE bots into a password protected site.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 02-13-2009, 03:13 AM Re: Quick yes/no question
magicvw's Avatar
Extreme Talker

Posts: 233
Name: Vicky
Location: Brit in Bulgaria
Trades: 1
Quote:
Originally Posted by chrishirst View Post
There are ways of allowing SE bots into a password protected site.
How?

I know I cab authenticate adsense to show up on my protected pages, but I guess that's different?
__________________

Please login or register to view this content. Registration is FREE



Please login or register to view this content. Registration is FREE
magicvw is offline
Reply With Quote
View Public Profile Visit magicvw's homepage!
 
Old 02-14-2009, 12:15 PM Re: Quick yes/no question
jhendriana's Avatar
Novice Talker

Posts: 10
Trades: 0
im really believe NO. cause thats need username and passwords, thats why called protected dirs
jhendriana is offline
Reply With Quote
View Public Profile
 
Old 02-21-2009, 07:46 AM Re: Quick yes/no question
chrishirst's Avatar
Missing! presumed drunk.

Posts: 41,517
Name: Chris Hirst
Location: Blackpool. UK
Trades: 0
Quote:
Originally Posted by magicvw View Post
How?

I know I cab authenticate adsense to show up on my protected pages, but I guess that's different?
You give the crawlers you want to allow in a "free pass" by detecting the user agent signature and bypassing the authentication process if it is a match.
__________________
Chris. ->> Links are advertising NOT optimising!! <<-
A foolish consistency is the hobgoblin of little minds
Thought for today:- I SEO the only industry where all the cowboys are Indians?
chrishirst is offline
Reply With Quote
View Public Profile Visit chrishirst's homepage!
 
Old 02-21-2009, 09:24 AM Re: Quick yes/no question
Super Spam Talker

Posts: 921
Name: Web lover
Location: In hell with angels
Trades: 0
Mate I haven's understand the thread? What are you talking about?
__________________
Hosting Reviews:
Please login or register to view this content. Registration is FREE
and
Please login or register to view this content. Registration is FREE

Hosting Coupons:
Please login or register to view this content. Registration is FREE
@ $3.95 / mo
weblover50 is offline
Reply With Quote
View Public Profile Visit weblover50's homepage!
 
Old 02-24-2009, 10:18 PM Re: Quick yes/no question
zeruel's Avatar
Webmaster Talker

Posts: 515
Location: SouthEast
Trades: 0
Quote:
Originally Posted by weblover50 View Post
Mate I haven's understand the thread? What are you talking about?
lol. just read from the top. It's all english.

oh well, chrishirst hit the right point. That's how the bots crawl the sites. They are not like any other person browsing the website and checking it if they can access it or not. They are bots. Spiders. Far different from a human.
__________________

Please login or register to view this content. Registration is FREE
|
Please login or register to view this content. Registration is FREE
zeruel is offline
Reply With Quote
View Public Profile Visit zeruel's homepage!
 
Reply     « Reply to Quick yes/no question
 

Thread Tools Search this Thread
Search this Thread:

Advanced Search

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are Off
Pingbacks are Off
Refbacks are Off





   
RSS Feed  Feeds: RSS   JS   XML
RSS Feed  Feeds for this forum: RSS   JS   XML



Page generated in 0.52462 seconds with 12 queries