|
Okay... interesting answer. Do you put all URLs that you want to spider in a database, or do you put the URLs and the information itself into the database? ie) URL in one field, and text into another field of the same record? Does it make a difference if the articles are in their own folder, or should they be outside, directly under public_html/
|