Hello everybody.

I need some help as i need to create a new and faster database structure for my search engine. What would be the best way? i've had an idea to do eash website as in individual table but thats really difficult to search and will possibly be slower.

Any suggestions, thanks.

The database structure should follow the logical real world structure of the information you're going to hold in it. You firstly have to ask yourself, What data do I have? How is logically seperated? (i.e. 'Customers', 'Suppliers', 'Orders', 'Products', 'Categories') and finally How is it logically linked? ('Customers' make 'Orders' of 'Products', 'Suppliers' supply 'Products', 'Products' are members of 'Categories')
The database should be designed around that.

I dont understand what your saying.

You may wan't to hire a database administrator (DBA) to setup your database for you if you don't have a full understanding of how a RDBMS works.

What Minaki is saying is that you need to know what the data is you want to store and how it all relates to each other. Once you can tell us that, then you can begin designing your database around your data.

URL, Weight, Content (basically just the words and that), md5sum, crawled, date, time, id

Still no one? Is MySQL the best database for doing something like this?

It doesn't really make a great deal of difference what DB server you use, the most important point would be one that supports full text searching.

For a document search engine the best type of structure is an inverted index