1) Split files into chunks
Each file is divided into smaller blocks so transfers can be scheduled, retried, and verified independently.
Work in progress
Download faster with cooperative peers.
Distributed Downloader is a prototype system for splitting large files into verified chunks and retrieving them in parallel from multiple peers.
Architecture
Peer-to-peer
Transfer model
Chunk + parallel
Current stage
Early prototyping
Why this project exists
Traditional downloads rely on one source and one connection path, which can become a bottleneck. This project explores a cooperative model where nodes can share chunks directly while preserving integrity and consistency.
The implementation is still evolving. Current work focuses on chunk orchestration, peer discovery, and resilient transfer behavior under unreliable network conditions.
How it works
2) Discover available peers
Peers advertise chunk availability to help receivers choose efficient transfer sources.
3) Download in parallel
Multiple chunks are fetched concurrently to maximize throughput and reduce end-to-end latency.
4) Verify and assemble
Checks validate integrity before chunks are stitched back into a complete file.
What is next
- Publish benchmark results for single-source vs distributed transfers
- Document chunk exchange and verification protocol diagrams
- Add notes on fault recovery and peer churn handling
Follow progress
Want implementation details, design notes, or future experiments? Track updates directly in the repository.
View repository updates