Web Directories

**pgolovko** · 12-16-2006, 01:59 PM

Well, finally I've decided to release this little monster.

What the hell is ADP? ADP is short for Astanda Directory Project. It is a directory/search/spider engine, written in PHP with MySQL database support. Supports virtually unlimited ammount of links and pages. Powered by Smarty template engine, ADP can run in both dynamic and static modes. Proper full text boolean search with keyword relevance can chew on gigabytes of data.

There are too many new features to list them here, but the main are:

* Completely search engine friendly. (Google has alreay indexed almost 2000 pages from Astanda.com)
* A lot faster web spider.
* Build static directories and pages. (optional)
* DMOZ data import. (see categories at http://www.astanda.com )
* Good -looking, almost unbreakable Captcha. (see below)
* ADP can run as both directory and web spider, as directory alone, or as web spider alone.
* and whole lot more.

Download link: http://www.astanda.com/forums/viewtopic.php?t=151

**Andy_Wilson** · 02-04-2007, 08:51 AM

dude about your search engine how many results can it hold before starting to lag? Ive tried sphider and at about about 30k links it takes on average nearly 1 second to perform a search. I need about 100k links at least with minimum search time.

Thanks, looks to be a very good script though mate, nice work!
Andy

**pgolovko** · 07-05-2007, 11:05 AM

Astanda.com runs on ADP 1.3 with over 100,000 links without any lag, here's some stats:

Code:

Main categories: 10
Sub categories: 64
Total categories: 74

Recip links: 40
Non-Recip links: 6755
Total links: 6795

Recip pages: 315
Non-Recip pages: 111622
Total pages: 111937

Banned URLs: 8
Banned Keywords: 6

===================================

Table: bad_keywords
Last Update: 2007-03-29 06:30:55
Data Size: 120 bytes
Index Size: 2048 bytes
Total Size: 2168 bytes
Total Rows: 6
Average Size Per Row: 20 bytes

Table: banned
Last Update: 2007-05-04 19:04:21
Data Size: 196 bytes
Index Size: 2048 bytes
Total Size: 2244 bytes
Total Rows: 8
Average Size Per Row: 24 bytes

Table: categories
Last Update: 2007-07-02 13:56:56
Data Size: 17640 bytes
Index Size: 2048 bytes
Total Size: 19688 bytes
Total Rows: 74
Average Size Per Row: 238 bytes

Table: config
Last Update: 2007-07-05 08:01:03
Data Size: 552 bytes
Index Size: 2048 bytes
Total Size: 2600 bytes
Total Rows: 1
Average Size Per Row: 552 bytes

Table: links
Last Update: 2007-07-03 14:31:53
Data Size: 1387616 bytes
Index Size: 1691648 bytes
Total Size: 3079264 bytes
Total Rows: 6795
Average Size Per Row: 204 bytes

Table: new_links
Last Update: 2007-07-05 06:14:33
Data Size: 113248 bytes
Index Size: 7168 bytes
Total Size: 120416 bytes
Total Rows: 422
Average Size Per Row: 268 bytes

Table: pages
Last Update: 2007-07-03 16:17:53
Data Size: 323485432 bytes
Index Size: 174842880 bytes
Total Size: 498328312 bytes
Total Rows: 111937
Average Size Per Row: 2889 bytes

Table: search_log
Last Update: 2007-04-21 14:25:38
Data Size: 724928 bytes
Index Size: 222208 bytes
Total Size: 947136 bytes
Total Rows: 906
Average Size Per Row: 657 bytes

Total database size: 502501828 bytes

I've seen directories with a lot more links that that, and nobody has yet complained about the speed

**ADAM Web Design** · 07-05-2007, 02:34 PM

Your character encoding is all messed, dude. Your directory categories seem limited, too (for example, where would blogs go?)

I attached a screen cap for the character encoding so you could see it for yourself.

I don't know...I just don't see the benefit to this ADP thing.

**pgolovko** · 07-05-2007, 05:18 PM

Use brower settings to adjust your Encoding. What you have screen shot of is I was showing one guy that ADP can support virtually any language out there with Cyrillic as an example in UTF-8 encoding. ADP 1.3 was sucesfully tested with many different languages, including Chinese and Arabic.