Server issues?

Current eOn code and boinc distributed computing

Moderator: moderators

DigiK-oz
Posts: 5
Joined: Sat Sep 04, 2010 8:51 am

Re: Server issues?

Post by DigiK-oz »

Saenger wrote:
DigiK-oz wrote:or even a swap to a different project running at the same PC?
Checkpointless WUs should not swap to another project. But if you have "Keep WUs in memory" selected, it wouldn't matter anyway.
True, but with 8 CPUs running longer eon WU's without checkpointing any system shutdown would be a waste of CPU time (and points :) )

But checkpointing will be implemented at that time, so another concern gone!
Saenger
Posts: 29
Joined: Thu Sep 02, 2010 4:23 pm
Contact:

Re: Server issues?

Post by Saenger »

DigiK-oz wrote:any system shutdown would be a waste of CPU time
System shutdown?? WTF is a system shutdown? Never heard of that strange behaviour. ;) :D
carlos
Posts: 11
Joined: Wed May 25, 2005 5:25 pm

Re: Server issues?

Post by carlos »

Right now the workunits generator can't handle the needs. I have lots of idle times on all my cores. Why not put the Henkelman Group Clusters generating workunits?
carlos
Posts: 11
Joined: Wed May 25, 2005 5:25 pm

Re: Server issues?

Post by carlos »

3 hours in idle....

Code: Select all

11/09/2010 05:34:48    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:36:00    eon2    update requested by user
11/09/2010 05:36:04    eon2    Sending scheduler request: Requested by user.
11/09/2010 05:36:04    eon2    Requesting new tasks
11/09/2010 05:36:06    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:36:06    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:37:11    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:37:11    eon2    Requesting new tasks
11/09/2010 05:37:13    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:37:13    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:39:19    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:39:19    eon2    Requesting new tasks
11/09/2010 05:39:22    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:39:22    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:40:46    eon2    update requested by user
11/09/2010 05:40:47    eon2    Sending scheduler request: Requested by user.
11/09/2010 05:40:47    eon2    Requesting new tasks
11/09/2010 05:40:51    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:40:51    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:41:56    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:41:56    eon2    Requesting new tasks
11/09/2010 05:41:58    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:41:58    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:44:05    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:44:05    eon2    Requesting new tasks
11/09/2010 05:44:07    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:44:07    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:46:13    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:46:13    eon2    Requesting new tasks
11/09/2010 05:46:15    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:46:15    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:51:25    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:51:25    eon2    Requesting new tasks
11/09/2010 05:51:27    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:51:27    eon2    Message from server: (Project has no jobs available)
11/09/2010 05:55:35    eon2    Sending scheduler request: To fetch work.
11/09/2010 05:55:35    eon2    Requesting new tasks
11/09/2010 05:55:38    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 05:55:38    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:05:42    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:05:42    eon2    Requesting new tasks
11/09/2010 06:05:44    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:05:44    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:15:47    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:15:47    eon2    Requesting new tasks
11/09/2010 06:15:48    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:15:48    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:25:51    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:25:51    eon2    Requesting new tasks
11/09/2010 06:25:53    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:25:53    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:26:59    eon2    Sending scheduler request: To fetch work.
11/09/2010 06:26:59    eon2    Requesting new tasks
11/09/2010 06:27:01    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:27:01    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:37:05    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:37:05    eon2    Requesting new tasks
11/09/2010 06:37:07    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:37:07    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:47:10    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:47:10    eon2    Requesting new tasks
11/09/2010 06:47:12    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:47:12    eon2    Message from server: (Project has no jobs available)
11/09/2010 06:57:16    eon2    Sending scheduler request: Requested by project.
11/09/2010 06:57:16    eon2    Requesting new tasks
11/09/2010 06:57:18    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 06:57:18    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:07:21    eon2    Sending scheduler request: Requested by project.
11/09/2010 07:07:21    eon2    Requesting new tasks
11/09/2010 07:07:23    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:07:23    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:17:27    eon2    Sending scheduler request: Requested by project.
11/09/2010 07:17:27    eon2    Requesting new tasks
11/09/2010 07:17:31    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:17:31    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:19:37    eon2    Sending scheduler request: To fetch work.
11/09/2010 07:19:37    eon2    Requesting new tasks
11/09/2010 07:19:39    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:19:39    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:29:43    eon2    Sending scheduler request: Requested by project.
11/09/2010 07:29:43    eon2    Requesting new tasks
11/09/2010 07:29:45    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:29:45    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:39:48    eon2    Sending scheduler request: Requested by project.
11/09/2010 07:39:48    eon2    Requesting new tasks
11/09/2010 07:39:50    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:39:50    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:42:58    eon2    Sending scheduler request: To fetch work.
11/09/2010 07:42:58    eon2    Requesting new tasks
11/09/2010 07:43:01    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:43:01    eon2    Message from server: (Project has no jobs available)
11/09/2010 07:53:04    eon2    Sending scheduler request: Requested by project.
11/09/2010 07:53:04    eon2    Requesting new tasks
11/09/2010 07:53:06    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 07:53:06    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:03:10    eon2    Sending scheduler request: Requested by project.
11/09/2010 08:03:10    eon2    Requesting new tasks
11/09/2010 08:03:12    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:03:12    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:13:15    eon2    Sending scheduler request: Requested by project.
11/09/2010 08:13:15    eon2    Requesting new tasks
11/09/2010 08:13:17    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:13:17    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:23:20    eon2    Sending scheduler request: Requested by project.
11/09/2010 08:23:20    eon2    Requesting new tasks
11/09/2010 08:23:23    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:23:23    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:24:55    eon2    update requested by user
11/09/2010 08:24:59    eon2    Sending scheduler request: Requested by user.
11/09/2010 08:24:59    eon2    Requesting new tasks
11/09/2010 08:25:01    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:25:01    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:26:06    eon2    Sending scheduler request: To fetch work.
11/09/2010 08:26:06    eon2    Requesting new tasks
11/09/2010 08:26:08    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:26:08    eon2    Message from server: (Project has no jobs available)
11/09/2010 08:27:13    eon2    Sending scheduler request: To fetch work.
11/09/2010 08:27:13    eon2    Requesting new tasks
11/09/2010 08:27:15    eon2    Scheduler request completed: got 0 new tasks
11/09/2010 08:27:15    eon2    Message from server: (Project has no jobs available)
matt
Posts: 37
Joined: Thu Jul 17, 2008 10:51 pm

Re: Server issues?

Post by matt »

We're planning to add on a lot of simulations in the next week. This should fix the problem.
Conan
Posts: 18
Joined: Wed Sep 08, 2010 1:03 pm

Re: Server issues?

Post by Conan »

Why is it that two computers (both AMD Phenom II X4 955 @3.2 GHz) one running Windows XP and the other running Linux Fedora 11 get so different points per WU?

Windows about 21 cr/h
Linux about 10 cr/h

If it is based on benchmarks then I will be stopping the Linux machine due to the poor returns.

Sorry to bring the credit debate up on the project but I am curious.
chill
Posts: 96
Joined: Tue Jul 28, 2009 9:04 pm

Re: Server issues?

Post by chill »

Conan wrote:Why is it that two computers (both AMD Phenom II X4 955 @3.2 GHz) one running Windows XP and the other running Linux Fedora 11 get so different points per WU?

Windows about 21 cr/h
Linux about 10 cr/h

If it is based on benchmarks then I will be stopping the Linux machine due to the poor returns.

Sorry to bring the credit debate up on the project but I am curious.
I'm not sure why but the benchmark reported that the linux machine does 1.57 GFLOPS and the windows machine does 3.2 GFLOPS. Why don't you rebenchmark the linux machine?
chill
Posts: 96
Joined: Tue Jul 28, 2009 9:04 pm

Re: Server issues?

Post by chill »

zombie67 wrote:
chill wrote:However, currently I plan on implementing the server and client side compression to help this issue somewhat.
Any news?
We have client side compression working (meaning the client compresses the results), but I cannot get the server side compression working. The boinc client doesn't properly unzip the files apache is serving. I'm looking at maybe just doing the compression in the compute client.
Conan
Posts: 18
Joined: Wed Sep 08, 2010 1:03 pm

Re: Server issues?

Post by Conan »

chill wrote:
Conan wrote:Why is it that two computers (both AMD Phenom II X4 955 @3.2 GHz) one running Windows XP and the other running Linux Fedora 11 get so different points per WU?

Windows about 21 cr/h
Linux about 10 cr/h

If it is based on benchmarks then I will be stopping the Linux machine due to the poor returns.

Sorry to bring the credit debate up on the project but I am curious.
I'm not sure why but the benchmark reported that the linux machine does 1.57 GFLOPS and the windows machine does 3.2 GFLOPS. Why don't you rebenchmark the linux machine?
Unfortunately that will do no good as benchmarking for Linux has been penalised since inception and on same hardware will not equal a Windows machine. It has something to do with the compilers used I believe.
I have seen very high scores on some Linux machines but I believe that they are 64 bit machines.

So from your answer points granted are based on Boinc benchmarking then.
I will leave the Windows machine on the project.
Thanks for your answer.
matt
Posts: 37
Joined: Thu Jul 17, 2008 10:51 pm

Re: Server issues?

Post by matt »

Once we incorporate more accurate simulation methods, our WUs will be much longer and have checkpointing.
carlos
Posts: 11
Joined: Wed May 25, 2005 5:25 pm

Re: Server issues?

Post by carlos »

Is it possible to change the number of tasks downloaded from 4 to (number of cores+2) or to 8? When a task is finished there's still a few minutes of cpu idle while waiting for the server connection.
Matthias Lehmkuhl
Posts: 5
Joined: Wed Oct 13, 2010 9:11 pm

Re: Server issues?

Post by Matthias Lehmkuhl »

Hi,
have a problem while downloading files on a Linux system.
Can't download files, while eOn needs 950 MB file space,

Message from server:
eOn client needs 211 MB more disk space, You currently have 740 MB free space available and it needs 954 MB.

Can you change these settings to a more realistic value, on Windows the eOn Client needs only round 10 MB file space.

regards
Matthias
matt
Posts: 37
Joined: Thu Jul 17, 2008 10:51 pm

Re: Server issues?

Post by matt »

carlos wrote:Is it possible to change the number of tasks downloaded from 4 to (number of cores+2) or to 8? When a task is finished there's still a few minutes of cpu idle while waiting for the server connection.
Due to the nature of our current simulations, work units can lose usefulness quickly. As such, queued work units could go to waste. However, we are planning on implementing new methods and more accurate calculations, which will lead to much longer work units.
matt
Posts: 37
Joined: Thu Jul 17, 2008 10:51 pm

Re: Server issues?

Post by matt »

Matthias Lehmkuhl wrote:Hi,
have a problem while downloading files on a Linux system.
Can't download files, while eOn needs 950 MB file space,

Message from server:
eOn client needs 211 MB more disk space, You currently have 740 MB free space available and it needs 954 MB.

Can you change these settings to a more realistic value, on Windows the eOn Client needs only round 10 MB file space.

regards
Matthias
This should not be happening. Are you running 32 or 64 bit Linux?
Matthias Lehmkuhl
Posts: 5
Joined: Wed Oct 13, 2010 9:11 pm

Re: Server issues?

Post by Matthias Lehmkuhl »

matt wrote:
Matthias Lehmkuhl wrote:Hi,
have a problem while downloading files on a Linux system.
Can't download files, while eOn needs 950 MB file space,

Message from server:
eOn client needs 211 MB more disk space, You currently have 740 MB free space available and it needs 954 MB.

Can you change these settings to a more realistic value, on Windows the eOn Client needs only round 10 MB file space.

regards
Matthias
This should not be happening. Are you running 32 or 64 bit Linux?
Hi Matt,
I'm running Ubuntu Linux 64 bit with 32 bit library, spinhenge works fine.

Did some configuration on one of my windows systems where eOn gets results and works fine.
Used file space for boinc is 1,26 GB.
Now I reduced the allowed file space for Bonic by local configuration from 10 GB down to 2 GB.
14.10.2010 18:51:52 max disk usage: 2.00GB

After this boinc shows me round 760 Mb free file space for Boinc use.
Now I get also this server message when Boinc trys to get new results.

14.10.2010 19:40:59 eon2 Message from server: eOn Client needs 240.34MB more disk space. You currently have 713.34 MB available and it needs 953.67 MB.

14.10.2010 20:14:29 max disk usage: 10.00GB
14.10.2010 20:16:39 eon2 Started download of 1496161884_2442_84855500.tgz

After this Boinc gets again results from eOn

best regards
Matthias
Post Reply