Consider a tar file, or some other archive format of many files, which is becoming available as blocks in random order, perhaps through bittorrent. Unpack the files in the underlying archive as they becomes available, instead of storing the whole thing then unpacking it. This is to save disk space.
Blocks corresponding to incomplete files will require some overhead.
Bittorrent itself however already has a mechanism for distributing collections of files as one torrent.
No comments :
Post a Comment