Ticket #267 (new enhancement)

Opened 1 year ago

Last modified 4 months ago

Intelligent Download Skipping

Reported by: rob Assigned to:
Priority: critical Milestone:
Component: Preferences Version: trunk
Keywords: Intelligent File Skipping Cc:
Operating System: All

Description

Currently you can overwrite, skip, or rename duplicate filename downloads. Instead: if there is a filename collision, detect the file's size. If the file sizes are identical, SKIP the download. Otherwise rename.

This is very useful for games, swfs, zips, exes, and some other files (not as useful for MP3s... but you could make it if it's within a few KBs skip it)

This would be a preference setting just like the "rename/overwrite" thing is now.

Change History

(follow-up: ↓ 2 ) 2007-09-06 05:51:07 changed by TheBlackCat

I think this is a great idea. However, using file size is not necessary reliable. Using a quick checksum algorithm instead would be better (or better yet have the ability to pick between the two). DTA already has several checksum calculators that I assume could also be used for this.

(follow-up: ↓ 2 ) 2007-09-06 05:56:37 changed by TheBlackCat

I think this is a great idea. However, using file size is not necessary reliable. Using a quick checksum algorithm instead would be better (or better yet have the ability to pick between the two). DTA already has several checksum calculators that I assume could also be used for this.

(in reply to: ↑ 1 ) 2007-11-21 09:01:27 changed by stefano.verna

Replying to TheBlackCat:

I think this is a great idea. However, using file size is not necessary reliable. Using a quick checksum algorithm instead would be better (or better yet have the ability to pick between the two). DTA already has several checksum calculators that I assume could also be used for this.

This would be a great.. but unfortunately the checksum, in order to be calculated, needs the file to be downloaded, so obviously this method cannot be used to prevent downloading the same file more than once :) On the other hand, the declared file size on the HTTP header is in many cases different from the reality and two different files can have the very same file size.

(in reply to: ↑ description ) 2008-07-25 12:42:28 changed by tillz

Replying to rob:

This is very useful for games, swfs, zips, exes, and some other files (not as useful for MP3s... but you could make it if it's within a few KBs skip it)

i think this would work, and proably dta could log the files which wasn't downloaded completely and then it would say "this file could be corrupted, download again"