Hi,

I am currently working in JAVA and C/C++/C# and a little Haskell so... I never really had to work with the data within a website.

This is what i want to do:

http://uk.file2hd.com/Default.aspx is like a processor for web pages. It receives an URL and it returns the links to a content of your choice (audio content, for example)

Using the website http://uk.file2hd.com/Default.aspx i want to download the mp3 files from another given website using a application created by me (not the browser) or a script of some kind (in this case using the browser [Firefox])

Now i use the website like this (the "normal way"):

1. write the url of the other site containing the mp3 files in the search box
2. hit the button "Get files"
3. wait until the page loads
4. click one of the links returned
5. repeat the process with another website with mp3s in it.

Getting a HTML webpage is simple (using the programming languages mentioned above) BUT the website http://uk.file2hd.com/Default.aspx is not using HTML (i think it uses java script, that is why i posted here). So i don't know how to make an app. that "simulates" the human and normal behavior.

So... please tell me if it is possible to do such a program. If YES (most probably) please tell me if i can do it in JAVA or the C family.
Other language sugestions are welcome as long it resolves my "problem" . Learning another language is not an issue.

Thank you.

Since you have experience with Java, take a look at the rhino javascript interpreter.
It's used in quite a few similar apps, notably HtmlUnit to test ajax applications.

Then again, this raises a lot of questions.

Why use another website to get files instead of getting them directly?

Why do you want to steal content from other sites?

First, thank you for the quick response. I will take into consideration your suggestions immediately after i finish writing this reply.

Originally Posted by willcode4beer

Why use another website to get files instead of getting them directly?

I thought that using the website mentioned above will be the simple way. Think that i have to download the mp3s from MySpace :|. You know how stupid and crowded are those pages.

Originally Posted by willcode4beer

Why do you want to steal content from other sites?

I have a simple, secondary and temporary job as a data entry .
A few months ago I had to work about 16 to 20 hours per week. Of course being a data entry job some steps repeat. After just a week of working, i decided to write a script that moves the mouse, clicks and presses keys. This way I shortened my time to 2 hours.

So... 2 hours per week is not much But as an experiment and curiosity i would like to automatize the process completely using... something.

To answer your question: i don't steal anything. I never keep the mp3s. I never listen them . I'm just a "proxy" between the content from myspace and the server i finally upload the mp3's.

L.E.

HTMLUnit Seems very promising from the first phrase: "HtmlUnit is a "GUI-Less browser for Java programs"".

Oh... BTW: If someone has other suggestions I would like to here them. You can never have to much sources of information or alternatives.

We use HtmlUnit quite a bit for testing.
Seems, you could point it at a page, get all of the links (there's a method for it) and use Commons HttpClient to retrieve the files.