Weird result granted credit

Message boards : Number crunching : Weird result granted credit
Message board moderation

To post messages, you must log in.

AuthorMessage
Graham H

Send message
Joined: 28 May 99
Posts: 21
Credit: 84,774
RAC: 0
United Kingdom
Message 104710 - Posted: 28 Apr 2005, 1:58:56 UTC

On viewing my results, I noticed another SETI user returned a value of 0.00 CPU time and claimed a credit of 0.00.
Another user claimed 240.19 seconds of CPU time and credit of 0.29.

I ended up in the middle with a CPU usage of 56.84 seconds and claimed a credit of 0.18.

Therefore, this cock-eyed system granted the first user a credit of 0.18 for no actual work, whilst denying the last user better credit that may have occured if a 4th users figures had been incorporated and the whole thing averaged.

If this is possible with this software, perhaps half of us should throw in the towel, do no SETI work at all on our computers and let the rest do the work for us whilst we gain the credit?

I still have the ID of the "miscreant" if anybody is interested, provided the results are not wiped from the system at the end of the month as occurred at the end of March.
ID: 104710 · Report as offensive
Profile Steve Cressman
Volunteer tester
Avatar

Send message
Joined: 6 Jun 02
Posts: 583
Credit: 65,644
RAC: 0
Canada
Message 104728 - Posted: 28 Apr 2005, 2:49:58 UTC

Some computers don't record a time if it less than a certain number of seconds run. The same miniscule little bit of work was still done so credit was granted.

98SE XP2500+ @ 2.1 GHz Boinc v5.8.8

And God said"Let there be light."But then the program crashed because he was trying to access the 'light' property of a NULL universe pointer.
ID: 104728 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 104735 - Posted: 28 Apr 2005, 2:58:49 UTC - in response to Message 104710.  

> On viewing my results, I noticed another SETI user returned a value of 0.00
> CPU time and claimed a credit of 0.00.
> Another user claimed 240.19 seconds of CPU time and credit of 0.29.
>
> I ended up in the middle with a CPU usage of 56.84 seconds and claimed a
> credit of 0.18.
>

There have been some bugs in how BOINC keeps track of cpu-time, there end-time is reported as cpu-time at last checkpoint before end. Since this wu was "noisy" and therefore terminated very early, the last checkpoint for one of the crunchers was at zero cpu-time.

In seti most wu isn't "noisy", so an ocassional zero-granted 1-minute-wu isn't really a problem. In other projects like LHC on the other hand it has been a much bigger problem.

Anyway, bug-fix will be included in next seti-application.


BTW, only results passing validation gets any credit, and the validator doesn't care whatever claimed credit a result has till after results validated. So it's not anyone not crunching the wu correctly, but a bug with reporting correct cpu-time.
ID: 104735 · Report as offensive
Graham H

Send message
Joined: 28 May 99
Posts: 21
Credit: 84,774
RAC: 0
United Kingdom
Message 104976 - Posted: 29 Apr 2005, 0:34:47 UTC

In response to Steve Cressman's comment:
The computer that returned the zero value was a Pentium Mobile at 1500MHz. I run an AMD 3200+XP. He might have run a close second to me at 57 seconds but there is no way that he could have crunched that result in no time at all.

The bug problem sounds like the best answer.

I don't mind if there is such a problem, as long as the software is not open to "crooks" capable of manipulating their results.
ID: 104976 · Report as offensive
Profile Steve Cressman
Volunteer tester
Avatar

Send message
Joined: 6 Jun 02
Posts: 583
Credit: 65,644
RAC: 0
Canada
Message 104980 - Posted: 29 Apr 2005, 0:42:19 UTC
Last modified: 29 Apr 2005, 0:45:01 UTC

I wasn't reporting a bug , I was responding to the original question and telling him that some computers won't record a time if the WU does not run long enough.......

98SE XP2500+ @ 2.1 GHz Boinc v5.8.8

And God said"Let there be light."But then the program crashed because he was trying to access the 'light' property of a NULL universe pointer.
ID: 104980 · Report as offensive
Bill Barto

Send message
Joined: 28 Jun 99
Posts: 864
Credit: 58,712,313
RAC: 91
United States
Message 105059 - Posted: 29 Apr 2005, 4:40:01 UTC - in response to Message 104976.  

> In response to Steve Cressman's comment:
> The computer that returned the zero value was a Pentium Mobile at 1500MHz. I
> run an AMD 3200+XP. He might have run a close second to me at 57 seconds but
> there is no way that he could have crunched that result in no time at all.
>
> The bug problem sounds like the best answer.
>
> I don't mind if there is such a problem, as long as the software is not open
> to "crooks" capable of manipulating their results.
>
I have seen this frequently with the noisy workunits. Personally I don't get upset with credit awards in the hundredths.

I have not seen this happen with "normal" workunits.
ID: 105059 · Report as offensive
Graham H

Send message
Joined: 28 May 99
Posts: 21
Credit: 84,774
RAC: 0
United Kingdom
Message 105965 - Posted: 1 May 2005, 1:30:29 UTC - in response to Message 105059.  
Last modified: 1 May 2005, 1:38:30 UTC

I was not intending this to become a saga..........

If a result is reported before a particular machine has "updated it's time", that's one thing.
But strictly speaking, the result should not count when it is "validated". It is not logically possible to process a unit in zero time and therefore this result should have been rejected.
The work unit was not so small that it could be processed in milliseconds, as my result proves.

I am not arguing over credit for small units, but merely asking if this was a genuine return or a "smart guy with a modified piece of software" I know that it is possible to fiddle the benchmark programming to make a PC return a higher result for the Dhrystone result.
ID: 105965 · Report as offensive
Graham H

Send message
Joined: 28 May 99
Posts: 21
Credit: 84,774
RAC: 0
United Kingdom
Message 106699 - Posted: 3 May 2005, 0:57:33 UTC - in response to Message 105965.  

I guess that I must now add myself to the list of "suspects" ...........

The very same thing has happened to me - it would appear that on 30 April 2005 my machine reported a work unit with a time of zero and claimed a credit of zero, for which I was was granted credit of 0.43.

Swings and roundabouts at the moment then.
ID: 106699 · Report as offensive

Message boards : Number crunching : Weird result granted credit


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.