Ticket #63 (new enhancement)

Opened 1 year ago

Last modified 1 month ago

Per-domain limits

Reported by: Telcontar Assigned to:
Priority: minor Milestone:
Component: Downloads Version: ---
Keywords: top, per-server, per-domain, server, domain Cc:
Operating System: All

Description

DownThemAll enforces a strict global limit on the amount of files that can be transferred at once (Main > Max contemporary downloads). This is far too limiting. Generally, I want this set to 1 to lessen the load that I put on servers.

However, this limit of 1 concurrent transfer should be a per-domain setting. That is, I want to restrict DownThemAll to 1 transfer at once from *each site*, not overall. I have yet to see any software implement this, which is a great pity.

Right now, I have something like 200 MB of downloads queued up from one site, at 33 kB/sec: this is going to take a while. I cannot transfer any more files in DTA even from a completely different site, until this is done. In fact, no matter what the contemporary transfer limit is set to, the queue of items for the first site could fill it up and stop transfers from the next site from commencing.

The only question is how you define a domain. Do "www.site.com" and "foo.site.com" count as one domain, or two? (They're not the same server, but they most likely share the same gateway, so in fairness, they should count as the same domain.)

Attachments

serverswitcher.xpi (7.3 kB) - added by MaierMan on 09/23/07 06:30:54.
A little experiement: evenly distribute downloads over servers. Installable extension (requires beta2).
serverswitcher-r615.xpi (6.7 kB) - added by MaierMan on 09/24/07 04:59:31.
new version that fixes some bugs (still just an experiment :p)
serverswitcher-r664.xpi (9.4 kB) - added by MaierMan on 12/04/07 16:36:56.
New version featuring per-domain limits

Change History

09/23/07 06:18:39 changed by MaierMan

*** Ticket #266 marked duplicate of this one ***

09/23/07 06:21:09 changed by MaierMan

*** Old bug marked duplicate of this one ***

09/23/07 06:22:35 changed by MaierMan

*** Old bug marked duplicate of this one ***

09/23/07 06:30:54 changed by MaierMan

  • attachment serverswitcher.xpi added.

A little experiement: evenly distribute downloads over servers. Installable extension (requires beta2).

09/24/07 04:58:56 changed by MaierMan

The extension is tracked in sandbox/serverswitcher. Interested folks might do a checkout like this:

svn co http://code.downthemall.net/repos/sandbox/serverswitcher

09/24/07 04:59:31 changed by MaierMan

  • attachment serverswitcher-r615.xpi added.

new version that fixes some bugs (still just an experiment :p)

12/04/07 13:25:32 changed by MaierMan

*** Ticket #429 marked duplicate of this one ***

12/04/07 13:25:57 changed by MaierMan

*** Ticket #440 marked duplicate of this one ***

12/04/07 13:26:21 changed by MaierMan

  • keywords changed from per-server, per-domain, server, domain to top, per-server, per-domain, server, domain.

12/04/07 16:36:56 changed by MaierMan

  • attachment serverswitcher-r664.xpi added.

New version featuring per-domain limits

03/06/08 03:22:49 changed by MaierMan

For anybody interested in this:

I created a ServerSwitcher page, which I intent to update detailing progress and featuring latest downloads.

(follow-up: ↓ 10 ) 03/07/08 12:39:36 changed by Telcontar

Looks interesting. I'm surprised to see how many other people have been asking for this also.

However, you've designed it as a per-site limit, whereas I feel that this should be a global option that applies to all downloads in DownThemAll! (and what I read of other feature requests seems to concur). I'm OK with being able to configure it per domain also, but there should still be a default setting. I tried a domain of "*" but that didn't work.

Otherwise, looks good.

(in reply to: ↑ 9 ) 03/07/08 22:48:25 changed by MaierMan

Replying to Telcontar:

Looks interesting. I'm surprised to see how many other people have been asking for this also. However, you've designed it as a per-site limit, whereas I feel that this should be a global option that applies to all downloads in DownThemAll! (and what I read of other feature requests seems to concur). I'm OK with being able to configure it per domain also, but there should still be a default setting. I tried a domain of "*" but that didn't work. Otherwise, looks good.

Agreed. There should be also a global limit per domain.

(follow-up: ↓ 12 ) 03/17/08 21:01:20 changed by Lucas Malor

Even if I set limit to 1, uploaded.to doesn't accept dTa. Example:

http://uploaded.to/?id=gjig0w

(in reply to: ↑ 11 ) 04/26/08 16:03:04 changed by MaierMan

Replying to Lucas Malor:

Even if I set limit to 1, uploaded.to doesn't accept dTa. Example: http://uploaded.to/?id=gjig0w

Not a dTa issue, but a uploaded.to one (their damn self-invalidating one-time-links)

(follow-up: ↓ 17 ) 04/26/08 16:04:18 changed by MaierMan

ServerSwitcher 0.5 now includes a Global limit (the * domain).

04/26/08 19:03:21 changed by Lucas Malor

Can you add also a zero limit? Usually I download files with dTa by default. A zero limit will block dTa downloads from some sites (as uploaded.to) and normal Fx download will be used.

05/30/08 01:49:13 changed by MaierMan

*** Ticket #697 marked duplicate of this one ***

06/15/08 02:46:03 changed by MaierMan

*** Ticket #787 marked duplicate of this one ***

(in reply to: ↑ 13 ) 07/29/08 00:09:23 changed by Telcontar

Replying to MaierMan:

ServerSwitcher 0.5 now includes a Global limit (the * domain).

Brilliant! Thanks. Sorry, read this update months ago, but never got around to installing the update. Just needed it this evening, so I thought I'd give it a go. Works perfectly. Thanks again.