Rosetta using excessive disk space.

Message boards : Problems : Rosetta using excessive disk space.
Message board moderation

To post messages, you must log in.

AuthorMessage
FritzTCoyote

Send message
Joined: 19 Jun 22
Posts: 3
Message 1308 - Posted: 10 Aug 2022, 0:17:56 UTC
Last modified: 10 Aug 2022, 0:23:38 UTC

Getting tired of this message.
Rosetta@home: Notice from server
rosetta python projects needs 745.50MB more disk space. You currently have 18327.98 MB available and it needs 19073.49 MB.
8/9/2022 4:50:58 AM
That was with 90gb of SSD space allocated to BOINC.
No matter how much disk space I give to BOINC, Rosetta keeps asking for more.
This indicates a flaw in Rosetta's use of resources. So it is Banished from my rigs.
ID: 1308 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
W
Avatar

Send message
Joined: 15 Jan 22
Posts: 13
Message 1322 - Posted: 10 Aug 2022, 19:31:44 UTC - in response to Message 1308.  

boinc has several settings to limit disk usage
Use no more than X GB
Leave at least free X GB
Use no more than X% of total disk space
The limit can be on any of these settings
as well
1) Is there really that much FREE disk space?
2)isn't that space taken up by other projects so much that rosetta doesn't have enough?
You can see this information in the disk section with all the current values
(Or if you don't have this tab, press "view" -> "advanced view" inside the boinc manager window or the ctrl+shift+a keyboard shortcut)
Here is a link from the rosetta FAQ
https://boinc.bakerlab.org/rosetta/forum_thread.php?id=669#10352
In any case, it is up to you to choose which project to participate in :)
Regards W
ID: 1322 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
FritzTCoyote

Send message
Joined: 19 Jun 22
Posts: 3
Message 1323 - Posted: 11 Aug 2022, 12:27:23 UTC - in response to Message 1322.  
Last modified: 11 Aug 2022, 12:42:14 UTC

Thanks for the advice, sadly those tools have not helped.

I've used the BOINC settings to limit its use for all projects to 90gb on an SSD with nearly a TB of free space. Every so often I got an alert message that Rosetta needed more storage, so I allocated more storage. And a month later its back like a crackhead, looking for just one more taste of that sweet disk space.

Traffic on the forum indicates this disk consumption problem goes back at least a year. Rosetta wants to run in as many threads as possible, and each thread gets an enormous working set of data. So far the Rosetta team has not seen this as a problem. But I do. If there were a way to throttle Rosetta's consumption, such as limit the number of threads it tries to use, I would do so.

I suspect that the real problem is an inherent weakness in grid computing: There is less incentive for efficiency, as the brute force of the grid will mask performance problems.
ID: 1323 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
W
Avatar

Send message
Joined: 15 Jan 22
Posts: 13
Message 1325 - Posted: 11 Aug 2022, 23:28:59 UTC - in response to Message 1323.  

I agree that some things are solved not by optimization but just by brute force, but that's life
redesign and optimization need a lot of man hours and money, which unfortunately many projects do not have, as sad as it sounds ¯\_(ツ)_/¯
here's something else you can try:
if you still want to give rosetta@home a chance you can register on their website and go to personal settings, maybe there are settings that can solve the problem
if you can fix the problem in the rosetta@home settings, you can try another account manager
like https://www.boincstats.com/bam/ where you can add an already registered account (or create a new one automatically within the bam site) it takes into account the changes made on the settings pages of the projects
But then the "united" part would be lost https://scienceunited.org/doc/ui_goals.pdf
or you can just stay with rosetta turned off in science united

Regards W
ID: 1325 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
FritzTCoyote

Send message
Joined: 19 Jun 22
Posts: 3
Message 1326 - Posted: 12 Aug 2022, 18:02:12 UTC - in response to Message 1325.  

8<snip>8
redesign and optimization need a lot of man hours and money, which unfortunately many projects do not have, as sad as it sounds ¯\_(ツ)_/¯
8<snip>8

And a limited project budget also results in the coding being done by undergrads using a lot of copy-paste.

<*dramatic sigh*>
They don't make em like Mel The Real Programmer anymore.
ID: 1326 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
BillThor

Send message
Joined: 9 Oct 20
Posts: 2
Message 1342 - Posted: 16 Aug 2022, 21:01:09 UTC

Rosetta@home unusable

I have run into numerous issues with Rosetta@home
- Required CPU severely unestimated - may be virtualized to another architecture. At 100% CPU usage it takes 30 to 60 seconds to report 1 second of CPU. System CPU usage is much higher than when other applications are running (about 1/3 of CPU utilization).
- Unable to parse the documented format of an app-info.xml file, and appears unable to apply an increase in CPU count.
- Automatically resets the no tasks settings and downloads more tasks.
- Requested memory resources are extremely overestimated limiting running tasks to 1.
- Ignores setting disabling VirtualBox applications.

My system is running Ubuntu 22.04 on an Intel Core i3-2100 CPU using the packaged BOINC and Virtualbox software. Other vbox applications seem to run correctly.
ID: 1342 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
W
Avatar

Send message
Joined: 15 Jan 22
Posts: 13
Message 1343 - Posted: 17 Aug 2022, 20:38:51 UTC - in response to Message 1342.  

- Automatically resets the no tasks settings and downloads more tasks.

It seems to me that this part is not done by rosetta@home itself, but by the account manager, try doing no task to resetta and then sync with science united.

If you do not want rosetta@home tasks you can exclude it from the "Scientific Areas and Locations" list in the settings
ID: 1343 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Problems : Rosetta using excessive disk space.


© 2024 UC Berkeley