Website and Server Administration Forum

**dimensio** · 11-05-2009, 01:08 PM

Hi,
I have shell access/whm/full root access to my current server. My old server only has FTP read only access as it is in recovery mode. I can't change this.

I can't use SFTP of SCP commands as they are disabled on first server.

I cant manually download then reupload to new server as its 90gb of files.

What I want to do is download all the files from the old server to the new server via FTP, however their are a lot of files so I don't want to have to manually select each file name and paste it in.

I need the equivalent to

Code:

 wget ftp://user:pass@91.91.91.91/backup/*.*

basically I need my new server to connect via FTP, retrieve directory contents, then download everything in that directory.

Please help me do this, i am completely stuck.

**whhelpguy** · 11-05-2009, 06:17 PM

Hi dimensio,

Do you know if your old server supports FXP (File eXchange Protocol)? I know that allows servers to exchange files.

You might want to try something like: http://www.smartftp.com/support/kb/what-is-fxp-f14.html

**dimensio** · 11-05-2009, 06:43 PM

Hi, it doesn't support FXP. tried with flashfxp, gives 500 error.

Currently I am using flashget site explorer, then using copy all links, then copying that into word, then adding wget ftp://user

***@ to the front of it, then downloading...

but this doesn't work very well as any file names with ( give an error message, such as files(5).zip and also I will have to go into every folder and repeat this and I don't have that kind of time.

any ideas?

are their any FTP url harvesters that will get all the urls of the files?

**tripy** · 11-05-2009, 09:32 PM

try

Code:

wget -r --limit-rate=50k ftp://user:pass@91.91.91.91/backup/

This should make wget go recursively over all your folders and limit the transfer speed to 50Ko/s.
Just to avoid satturating your network link.

And if you want to see what options you have:

Code:

man wget

to get the manual.

**dimensio** · 11-06-2009, 08:43 PM

Hi,
still no luck, it just told me that it had outputted a list of files??/

note: ip and passchanged in below copypaste

Code:

   root@server1 [/home/gt6/public_html/down]# wget -r -i --limit-rate=50k ftp://roo
  tftp:cur2r5NV@94.23.000.000/home/downloads/
  --19:39:43--  ftp://root:*password*@94.23.000.000/home/downloads/
             => `94.23.000.000/home/downloads/.listing'
  Connecting to 94.23.000.000:21... connected.
  Logging in as root ... Logged in!
  ==> SYST ... done.    ==> PWD ... done.
  ==> TYPE I ... done.  ==> CWD /mnt/home/downloads ... done.
  ==> PASV ... done.    ==> LIST ... done.
   
      [ <=>                                    ] 8,642       --.-K/s   in 0.1s
   
  19:39:44 (83.2 KB/s) - `94.23.000.000/home/downloads/.listing' saved [8642]
   
  Removed `94.23.000.000/home/downloads/.listing'.
  Wrote HTML-ized index to `94.23.000.000/home/downloads/index.html' [19782].
  --limit-rate=50k: No such file or directory
  No URLs found in --limit-rate=50k.
  root@server1 [/home/gt6/public_html/down]# wget -r -i --input-file=index.html --
  limit-rate=50k ftp://root:cur2r5NV@94.23.000.000/home/downloads/
  --19:40:43--  ftp://root:*password*@94.23.000.000/home/downloads/
             => `94.23.000.000/home/downloads/.listing'
  Connecting to 94.23.000.000:21... connected.
  Logging in as root ... Logged in!
  ==> SYST ... done.    ==> PWD ... done.
  ==> TYPE I ... done.  ==> CWD /mnt/home/downloads ... done.
  ==> PASV ... done.    ==> LIST ... done.
   
      [ <=>                                    ] 8,642       --.-K/s   in 0.1s
   
  19:40:44 (84.0 KB/s) - `94.23.000.000/home/downloads/.listing' saved [8642]
   
  Removed `94.23.000.000/home/downloads/.listing'.
  Wrote HTML-ized index to `94.23.000.000/home/downloads/index.html' [19782].
  --input-file=index.html: No such file or directory
  No URLs found in --input-file=index.html.
  root@server1 [/home/gt6/public_html/down]# wget -r -i --input-file=.listing --li
  mit-rate=50k ftp://root:cur2r5NV@94.23.000.000/home/downloads/
  --19:41:01--  ftp://root:*password*@94.23.000.000/home/downloads/
             => `94.23.000.000/home/downloads/.listing'
  Connecting to 94.23.000.000:21... connected.
  Logging in as root ... Logged in!
  ==> SYST ... done.    ==> PWD ... done.
  ==> TYPE I ... done.  ==> CWD /mnt/home/downloads ... done.
  ==> PASV ... done.    ==> LIST ... done.
   
      [ <=>                                    ] 8,642       --.-K/s   in 0.1s
   
  19:41:03 (82.8 KB/s) - `94.23.000.000/home/downloads/.listing' saved [8642]
   
  Removed `94.23.000.000/home/downloads/.listing'.
  Wrote HTML-ized index to `94.23.000.000/home/downloads/index.html' [19782].
  --input-file=.listing: No such file or directory
  No URLs found in --input-file=.listing.
  root@server1 [/home/gt6/public_html/down]# wget -i --input-file=index.html --lim
  it-rate=500k ftp://root:cur2r5NV@94.23.000.000/home/downloads/
  --19:41:24--  ftp://root:*password*@94.23.000.000/home/downloads/
             => `.listing'
  Connecting to 94.23.000.000:21... connected.
  Logging in as root ... Logged in!
  ==> SYST ... done.    ==> PWD ... done.
  ==> TYPE I ... done.  ==> CWD /mnt/home/downloads ... done.
  ==> PASV ... done.    ==> LIST ... done.
   
      [ <=>                                    ] 8,642       --.-K/s   in 0.09s
   
  19:41:25 (98.0 KB/s) - `.listing' saved [8642]
   
  Removed `.listing'.
  Wrote HTML-ized index to `index.html' [19782].
  --input-file=index.html: No such file or directory
  No URLs found in --input-file=index.html.
  root@server1 [/home/gt6/public_html/down]#

Please help I'm stuck

**tripy** · 09:01 PM

Why did you gave the -i parameter ???
This option specify that you give wget a list of files to be fetched from a file.

Quote:

-i file
--input-file=file
Read URLs from file. If - is specified as file, URLs are read from the standard input. (Use ./-
to read from a file literally named -.)

If this function is used, no URLs need be present on the command line. If there are URLs both on
the command line and in an input file, those on the command lines will be the first ones to be
retrieved. The file need not be an HTML document (but no harm if it is)---it is enough if the
URLs are just listed sequentially.

However, if you specify --force-html, the document will be regarded as html. In that case you
may have problems with relative links, which you can solve either by adding "<base href="url">"
to the documents or by specifying --base=url on the command line.

Of course, "--limit-rate=50k" being a invalid file name, it gives you an error message:

Quote:

No URLs found in --limit-rate=50k.

Forget the -i, and just give the root folder with -r.
wget will work his way alone from there.

**dimensio** · 11-25-2009, 04:07 PM

Hi, no luck using

wget -r --limit-rate=5000k ftp://gt6:fake@87.00.249.227/public_...wnloads/admin/

it is still writing to index.html, please help.

[code]

root@server [/home/gt6/public_html/oneclick]# wget -r --limit-rate=5000k ftp://g
t6:fake@87.00.249.227/public_html/torrent/downloads/admin/
--15:05:52-- ftp://gt6:*password*@87.00.249.227/public_html/torrent/downloads/a
dmin/
=> `87.00.249.227/public_html/torrent/downloads/admin/.listing'
Connecting to 87.00.249.227:21... connected.
Logging in as gt6 ... Logged in!
==> SYST ... done. ==> PWD ... done.
==> TYPE I ... done. ==> CWD /public_html/torrent/downloads/admin ... done.
==> PASV ... done. ==> LIST ... done.

[ <=> ] 1,389 --.-K/s in 0s

15:05:56 (12.0 MB/s) - `87.00.249.227/public_html/torrent/downloads/admin/.listi
ng' saved [1389]

Removed `87.00.249.227/public_html/torrent/downloads/admin/.listing'.
Wrote HTML-ized index to `87.00.249.227/public_html/torrent/downloads/admin/inde
x.html' [3217].
root@server [/home/gt6/public_html/oneclick]#

**tripy** · 11-25-2009, 04:41 PM

did you tried to connect with ftp ?
does it works?