Hi,

how do i make a search engine, and a bot which i can send to a list of urls or what ever which will index and add to search?...

Thanks,
TP for good answer(s)

Dan

The only way that I think that you could do that in PHP is to parse the web page (taking all of the info, putting into a web pag), and take all of the links from it, and store them in a temporary file.

Then you have the script take all of those links and parse those pages. It would take forever to do though, and it would take up massive bandwidth to do.

I don't think there's really an effective way to make an indexing script in PHP. If you think that you really could get this kinda thing working, I think it would be fun to work with you on it

Take a look at Sphider..!

I would love to have a WWW search engine but i know and have to accept the fact A) i dont have a dedicated server B) i couldnt afford the dedicated server on my own C) no one would pay for the dedicated server with me unless they would see profits soon

Seems a little hard to set up.

All of the PHP tags are short tags, they start with <? instead of <?php.

So...
why do people say this, i have yet to come across a server set up not to accept the short hand tags

Hmm, I guess. I just know that Apache, by default, is not set up to accept those.

its not apache... its the PHP engine

and i think is... at least in my local install it is never had any trouble,

and to be honest if ur with a host who hasnt set it to support it then erm.. find a new one ... i have great prices

Originally Posted by coolkbk585

Seems a little hard to set up.

All of the PHP tags are short tags, they start with <? instead of <?php.

Shouldn't be a problem.




What kind of search engine do you need?

well honestly i want to do it mainly to learn how to, just like a site one which maybe does a few domains.

Im thinking it cant be that hard a script for the bot.

not sure how i would do the actual search bit tho, which searches the DB for the pages. and then shows them.

but the bot i would have though would be like

readfile()

some how read the metas, not sure best way to do that

because it would have to basically first check for a meta for nofollow/no index etc, and have a

if(nofollow $follow = off)

elseif (nofollow and noindex) end searching page

and then get the metas get the and save the content in the field which matches the meta name,

also would want it to save the page size, URL title, and all that

guh anyone feel like explaining how i could do this?