Directory file transmission is waste of bandwidth

Technical RetroShare discussions Forum

Directory file transmission is waste of bandwidth

Postby ubuntu5001 » Wed May 09, 2012 7:16 am

Hi

Is it really necessary to transmit the entire directory file each time a new file is shared? Is it not possible to update the new information instead of the entire file?
If I add a 20 byte file to the shared files the entire 1MB directory file is sent again.

Thx
ubuntu5001
 
Posts: 16
Joined: Mon May 07, 2012 10:46 am

Re: Directory file transmission is waste of bandwidth

Postby apoapo » Wed May 09, 2012 4:07 pm

Cache management is re-written from scratch right now. I guess your point will be fixed with it.
apoapo
 
Posts: 189
Joined: Sun Jan 10, 2010 12:55 pm

Re: Directory file transmission is waste of bandwidth

Postby ubuntu5001 » Thu May 10, 2012 11:24 am

Thank you. That is good news.
ubuntu5001
 
Posts: 16
Joined: Mon May 07, 2012 10:46 am

Re: Directory file transmission is waste of bandwidth

Postby Naserich » Sat May 12, 2012 11:39 am

From my opinion:
If the shared file List is more than 1MB high, too much files are shared ;)
Naserich
 
Posts: 36
Joined: Mon Apr 02, 2012 12:05 pm

Re: Directory file transmission is waste of bandwidth

Postby sciurius » Fri Feb 22, 2013 8:49 pm

apoapo wrote:Cache management is re-written from scratch right now. I guess your point will be fixed with it.

Has this rewrite been completed in the current 0.5.4c version?

I ask this since the cache files are killing my disk space. Within a week I have several Gigs of data in my cache/remote directory. A well-connected friend (a system on my LAN) sends 10MB of data every 30 minutes. And no, its shares did not get updated in that time.

But the biggest problem seems to be that if a friend sends a new cache file, the older cache files are not removed.

I'm running 5605 (Fedora 17) and 6095 (Raspberry PI).
User avatar
sciurius
 
Posts: 10
Joined: Wed Dec 08, 2010 3:34 pm

Re: Directory file transmission is waste of bandwidth

Postby electron » Sun Feb 24, 2013 9:17 am

No, the new cache system is not completed.
electron
 
Posts: 96
Joined: Sun Aug 12, 2012 9:39 am

Re: Directory file transmission is waste of bandwidth

Postby sciurius » Fri Mar 01, 2013 10:54 am

Can anyone explain (or is it documented somewhere) how the cache files are used?

In my local cache, there are fc-own-*.rsfc files, that contain the index of my shares. These files are (have been) uploaded to my friends. After having been uploaded, can these files be discarded?

In my remote cache, there are share indexes of friends, and myself. These are used to build the file lists of friends in the 'Files' tab. Same question: when the file list is built, can these files be discarded? When a newer version from the same friend is received, can the older versions be discarded?
User avatar
sciurius
 
Posts: 10
Joined: Wed Dec 08, 2010 3:34 pm

Re: Directory file transmission is waste of bandwidth

Postby sciurius » Thu Apr 24, 2014 6:22 pm

electron wrote:No, the new cache system is not completed.

And in the 0.5.5c version?
User avatar
sciurius
 
Posts: 10
Joined: Wed Dec 08, 2010 3:34 pm

Re: Directory file transmission is waste of bandwidth

Postby csoler » Sat Apr 26, 2014 11:12 am

This will be re-wrote from scratch in v0.6. We're heading toward a system that syncs dir lists based on differences
and works both passively in the background and actively while you're browsing your friends' files with different priorities.

At the time of writing this, this is not implemented yet. But we're working on it!
csoler
 
Posts: 319
Joined: Tue Oct 28, 2008 10:33 am

Re: Directory file transmission is waste of bandwidth

Postby apoapo » Sun Apr 27, 2014 10:37 am

Thanks for updating us. I really appreciate your work.
apoapo
 
Posts: 189
Joined: Sun Jan 10, 2010 12:55 pm


Return to Technical RetroShare discussion

Who is online

Users browsing this forum: No registered users and 1 guest

cron