Ticket #98 (assigned enhancement)

Opened 2 years ago

Last modified 1 month ago

Allow user to add additional URI(s) that provide the same content

Reported by: taqueso Assigned to: MaierMan (accepted)
Priority: minor Milestone:
Component: Downloads Version: trunk
Keywords: download mirrors multiple hosts Cc:
Operating System: All

Description

When downloading large files that are available from several mirrors, it would be handy to allow adding an additional URI to the task. Downloads could be done in parallel from all of the URIs in the list, which should allow for a large speed improvement over downloading in parallel from the same host.

Possible problems: User can specify a URI that does not contain the same data. Some data could be downloaded from multiple URIs to verify that they match.

The current code probably isn't designed with this feature in mind and might require large changes.

How many parts would be used for each URI? For example, if 2 URIs are specified, does each receive 1/2 of the total allocated for the task or does each receive the number allocated, meaning that there are actually 2x as many streams as specified?

Change History

(follow-up: ↓ 2 ) 2007-04-15 05:27:31 changed by ant

I believe this is a duplicate of ticket:84

(in reply to: ↑ 1 ) 2007-04-29 16:46:29 changed by MaierMan

  • owner set to MaierMan.
  • status changed from new to assigned.
  • version changed from --- to trunk.

Replying to ant:

I believe this is a duplicate of ticket:84

I'd say that the other one depends on this one.

There is actually some code that allows mirroring on the trunk.
This was put in place to support metalink (at least the mirrors part).

Furthermore multi-part downloads already verify that the chunks point to the same resource using various metrics (e.g. Etag/Content-Length).

The problem currently is with the error handling. What to do when xyz is encountered? And so on. A lot of things still have to get figured out and implemented.

But it is definitively on the to-do list. Maybe not for 1.0, but later there will be such a feature.

2007-12-05 01:57:49 changed by MaierMan

*** Ticket #446 marked duplicate of this one ***

2008-05-30 01:47:24 changed by MaierMan

*** Ticket #708 marked duplicate of this one ***

2008-09-14 01:07:30 changed by MaierMan

*** Ticket #751 marked duplicate of this one ***

2008-09-14 01:08:12 changed by MaierMan

*** Ticket #776 marked duplicate of this one ***

2008-10-15 12:01:11 changed by QkEterror

Like I stated already in my duplicate (sorry) bugreport an extra feature could be to automatically search in ftp searches or google for extra download sources with the same name and size. When Go!Zilla wasn't loaded with spyware in the good old days it used to have this very useful feature. It dramatically increases the speed of most downloads since files are rarely available only in one place.