Hello everyone, I would like to set up a certain function for my site and was wondering if this is even achievable/possible. I am just now getting into PHP so you can definitely classify me as a newbie so if this question sounds ridiculous it's not because I'm dumb, it's because I don't know any better at this stage of my PHP proficiency.

Alright, so this is what I am hoping to set up:

from selected 20 sites, each of which features tens of articles daily, I want my site every day at a set time to be able to automatically scrape articles from these sites which meet certain conditions (for example articles that use certain keywords). Then I want my site to post links to all these relevant articles from these 20 sites that meet the conditions I have set.

Is this even doable or am I just a newbie that's way in over his head?

Its "doable" as any data on any website is scrapable.

However,
DOING it is no small task ( getting the data is easy )
Knowing what to get from where on the other hand is slightly more tricky.

It would simply be a case of getting the sites html and parsing out the bits you dont want.

Then storing it locally to then be displayed on your site.

Originally Posted by lynxus

Its "doable" as any data on any website is scrapable.

However,
DOING it is no small task ( getting the data is easy )
Knowing what to get from where on the other hand is slightly more tricky.

It would simply be a case of getting the sites html and parsing out the bits you dont want.

Then storing it locally to then be displayed on your site.

Thanks a lot for your reply lynxus, I really appreciate it.

Alright, this gives me hope for what I'm hoping to accomplish.

Apart from the consideration that you would be STEALING the content.

^You get too hung up on minor little details Chris You never know, they might not mind him stealing from them

Originally Posted by chrishirst

Apart from the consideration that you would be STEALING the content.

"Stealing"? Did you not read my original post or are you just looking to pick a fight just because?

Let me assist you in comprehending what I said in my original post:

I would be LINKING to their site whenever they post something that is fits my scraping criteria, meaning I would be driving traffic TO their sites

When you are scraping content from another site you are stealing it, regardless of your intent.

I would not be scraping anything from any site without their consent first

Without consent linking or not linking to their site it is still stealing, some don't mind as it does drive traffic to them, so do mind and will quite likely contact your host, quite often this results in the thiefs site being taken down till the issue is resolved.

Originally Posted by ThailandForum

Without consent linking or not linking to their site it is still stealing, some don't mind as it does drive traffic to them, so do mind and will quite likely contact your host, quite often this results in the thiefs site being taken down till the issue is resolved.

as I mentioned in my last post....

Originally Posted by Frank Drebin

I would not be scraping anything from any site without their consent first