Deadline = Upload or Report to Scheduler?

Message boards : Number crunching : Deadline = Upload or Report to Scheduler?
Message board moderation

To post messages, you must log in.

AuthorMessage
gomeyer
Volunteer tester

Send message
Joined: 21 May 99
Posts: 488
Credit: 50,370,425
RAC: 0
United States
Message 40783 - Posted: 27 Oct 2004, 21:16:26 UTC
Last modified: 27 Oct 2004, 21:17:35 UTC

Does anyone know for certain if the WU report date/time for deadline purposes is based on the upload date/time or the date/time when the WU's are actually reported to the Scheduler? I know the Work tab column header says "Report Deadline" so that may answer my question, but I guess I'm hoping that the wording on that is a little loose.

This may be a fine point, but it has become an important one on at least one of my machines with the current Scheduler outage. Of the completed WU's on that host, 6 of them "drop dead" tomorrow morning at about 07:00. They've certainly been uploaded, but BOINC cannot report them with the Scheduler down, and I've been trying since yesterday evening. Good timing huh?

This type of thing had never been a problem in the past, even with previous server outages. But between our bogus benchmarks and the very slow completion times of the new SAH client, it has now become a problem, for me at least. Since noticing that a close call was imminent I have changed my preferences to report more often but of course that doesn't help the current batch of WUs since too many had been previously downloaded.

Anyway, looks like I'm about to lose those 6 results unless the upload time is what really counts, and somehow I don't think so. NO, this is not the end of the world, but it is frustrating. Any informed information would be appreciated.

Thanks in advance!

*EDITED for Spelling*

ID: 40783 · Report as offensive
Tony Martin

Send message
Joined: 5 Dec 99
Posts: 91
Credit: 69,723
RAC: 0
United States
Message 40805 - Posted: 27 Oct 2004, 22:15:42 UTC - in response to Message 40783.  

With the project down no one can upload reports or download WU's. This means that when they get the project back running your WU's will report before any can be resent to someone else. This means that you will get your credit so keep your maching crunching the WU's you have and you will get your credit sooner or later. Hope this helps you out.



ID: 40805 · Report as offensive
Profile Toby
Volunteer tester
Avatar

Send message
Joined: 26 Oct 00
Posts: 1005
Credit: 6,366,949
RAC: 0
United States
Message 40806 - Posted: 27 Oct 2004, 22:16:51 UTC
Last modified: 27 Oct 2004, 22:18:16 UTC

I am pretty sure you are correct. If I understand the system correctly, the result file is uploaded immediately but nothing is done with it until the work is reported to the scheduler which then activates the validator and processes the results. HOWEVER... I have seen people report that they have reported a work unit after the deadline and still recieved credit - as long as the work unit hadn't been resent and already returned by another host. With the schedulers offline, that shouldn't be a problem :)

Watch what happens and report back to us :)

Edit: Well I see Tony beat me to the 'submit' button. My room mate distracted me, I swear! :)
A member of The Knights Who Say NI!
For rankings, history graphs and more, check out:
My BOINC stats site
ID: 40806 · Report as offensive
gomeyer
Volunteer tester

Send message
Joined: 21 May 99
Posts: 488
Credit: 50,370,425
RAC: 0
United States
Message 40810 - Posted: 27 Oct 2004, 22:33:31 UTC - in response to Message 40805.  
Last modified: 27 Oct 2004, 22:37:27 UTC

> With the project down no one can upload reports or download WU's. This means
> that when they get the project back running your WU's will report before any
> can be resent to someone else. This means that you will get your credit so
> keep your maching crunching the WU's you have and you will get your credit
>
Toby, Tony,

You both raise an interesting point that had not occurred to me.

> Watch what happens and report back to us :)

I have recorded those six WUs and will certainly follow up on them and share the results. (no pun intended)

> My room mate distracted me, I swear! :)

Hmmm. No, I won't go there.

Thanks guys.

*EDIT* again. This thing needs a spell checker. Yo! Janus. . .
ID: 40810 · Report as offensive
Aurora Borealis
Volunteer tester
Avatar

Send message
Joined: 14 Jan 01
Posts: 3075
Credit: 5,631,463
RAC: 0
Canada
Message 40817 - Posted: 27 Oct 2004, 23:00:22 UTC - in response to Message 40810.  


> *EDIT* again. This thing needs a spell checker. Yo! Janus. . .
>

If you're using IE or SlimBrowser, CrazyBrowser, MSN, MyIE, etc may I suggest

ieSpell from http://www.iespell.com/

It's a free Internet Explorer browser extension that spell checks text input boxes on a webpage.
The program installs as a new button in the IE toolbar amd also works (right-click menu only) on other IE based browsers.




Boinc V7.2.42
Win7 i5 3.33G 4GB, GTX470
ID: 40817 · Report as offensive
gomeyer
Volunteer tester

Send message
Joined: 21 May 99
Posts: 488
Credit: 50,370,425
RAC: 0
United States
Message 40820 - Posted: 27 Oct 2004, 23:08:25 UTC - in response to Message 40817.  

> If you're using IE or SlimBrowser, CrazyBrowser, MSN, MyIE, etc may I suggest
>
> ieSpell from http://www.iespell.com/

Installed an running. And it works!
Thank you sir!
ID: 40820 · Report as offensive
Aurora Borealis
Volunteer tester
Avatar

Send message
Joined: 14 Jan 01
Posts: 3075
Credit: 5,631,463
RAC: 0
Canada
Message 40824 - Posted: 27 Oct 2004, 23:43:21 UTC - in response to Message 40820.  

> > If you're using IE or SlimBrowser, CrazyBrowser, MSN, MyIE, etc may I
> suggest
> >
> > ieSpell from http://www.iespell.com/
>
> Installed an running. And it works!
> Thank you sir!
>

You're welcomed.

Now if the forum had a preview feature I'd be happy.



Boinc V7.2.42
Win7 i5 3.33G 4GB, GTX470
ID: 40824 · Report as offensive
Aurora Borealis
Volunteer tester
Avatar

Send message
Joined: 14 Jan 01
Posts: 3075
Credit: 5,631,463
RAC: 0
Canada
Message 40825 - Posted: 27 Oct 2004, 23:45:44 UTC - in response to Message 40820.  
Last modified: 27 Oct 2004, 23:47:34 UTC

duplicate post

Boinc V7.2.42
Win7 i5 3.33G 4GB, GTX470
ID: 40825 · Report as offensive
Tom Gutman

Send message
Joined: 20 Jul 00
Posts: 48
Credit: 219,500
RAC: 0
United States
Message 40921 - Posted: 28 Oct 2004, 8:52:23 UTC - in response to Message 40783.  

Work units do not drop dead at the deadline time. That is just when they become overdue. Two things happen at that time. First, a new copy of the work unit (a result) is created and queued for sending. Second, the work unit will no longer wait for your report. So if there are enough other results, and the appropriate process (I'm not sure which, probably either the transitioner or the deleter) gets to that unit, it will get deleted. As long as you report before the unit is closed out, you will get credit. At the moment there is a large pool of workunits waiting to be sent, and it seems to be several days before a newly created result is actually sent out. Then that result may take a while in being crunched and reported (if it is sent to me, it will be about two weeks).

Since they dumbed down the interface and decided to ignore one of the two queuing parameters I had specified I have a lot of work units that are past their deadline. So far all have reported in time to get credit, generally before the replacement result has even been sent out.

------- Tom Gutman
ID: 40921 · Report as offensive
Bill Barto

Send message
Joined: 28 Jun 99
Posts: 864
Credit: 58,712,313
RAC: 91
United States
Message 40954 - Posted: 28 Oct 2004, 14:01:53 UTC

A workunit that is reported after the deadline will receive credit even if three other results have already been granted credit. Here is an example:

http://setiweb.ssl.berkeley.edu/workunit.php?wuid=931937

ID: 40954 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34258
Credit: 79,922,639
RAC: 80
Germany
Message 40967 - Posted: 28 Oct 2004, 15:39:14 UTC

Hi

But the question is, why was this WU sent out to 4 hosts.
Normal is three hosts.
Just my two$ i think this will not be so many times.

greetz Mike



With each crime and every kindness we birth our future.
ID: 40967 · Report as offensive
Arm

Send message
Joined: 12 Sep 03
Posts: 308
Credit: 15,584,777
RAC: 0
Message 40968 - Posted: 28 Oct 2004, 15:55:17 UTC - in response to Message 40954.  
Last modified: 28 Oct 2004, 15:55:48 UTC

> A workunit that is reported after the deadline will receive credit even if
> three other results have already been granted credit. Here is an example:
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=931937
>
>
Another example - with my account:
I missed the deadline but the WU was not resent to somebody else. I uploaded it and reported it (both) after the deadline and I still received credit for it. Immediatly! :)
Here is the WU - I missed the deadline by 14 mins, but it doesnt matter - if it was resent Id be XXXed. At the bottom is the note about the WU was ready to be resent.


ID: 40968 · Report as offensive
Ingleside
Volunteer developer

Send message
Joined: 4 Feb 03
Posts: 1546
Credit: 15,832,022
RAC: 13
Norway
Message 40973 - Posted: 28 Oct 2004, 16:37:32 UTC - in response to Message 40954.  

> A workunit that is reported after the deadline will receive credit even if
> three other results have already been granted credit. Here is an example:
>
> http://setiweb.ssl.berkeley.edu/workunit.php?wuid=931937
>
>

Looking on the wu, this was back in August, and from one result passed deadline to new "result" generated used over 2 hours indicating backlogged transitioner. The validator seems to have run in a more or less timely manner since granted is middle of 3 first returned, but AFAIK next stop is the transitioner again, followed by Assimilator & file_deleter. If any of these backend-services wasn't running or backlogged, you can manage returning a too-late result and still get credit.
ID: 40973 · Report as offensive
Pepo
Volunteer tester
Avatar

Send message
Joined: 5 Aug 99
Posts: 308
Credit: 418,019
RAC: 0
Slovakia
Message 40983 - Posted: 28 Oct 2004, 17:25:12 UTC - in response to Message 40967.  

> But the question is, why was this WU sent out to 4 hosts.
> Normal is three hosts.
>
> greetz Mike
>
I think the better question is why was this WU initially (on 24 Jul 2004) sent to ONE host only? (Maybe database or disk directory problems these days?)
Sending to the following three hosts is clear.

Peter
ID: 40983 · Report as offensive
gomeyer
Volunteer tester

Send message
Joined: 21 May 99
Posts: 488
Credit: 50,370,425
RAC: 0
United States
Message 41038 - Posted: 28 Oct 2004, 21:46:57 UTC

Just to close out the issue that I had which started this, the scheduler came back up just in time and those 6 WUs reported with a few hours to spare, so I guess this was all a moot point. (Great work Berkeley!) However, there have been some interesting reports of slightly inconsistent results reported elsewhere in the thread.

BTW, I checked back on my doggiest machine which had been running close to the deadline and found one result that reported about 3 hours late and was still accepted. So bottom line I guess it's just the luck of the draw (or the scheduler) on those.

I'm not going to lose too much sleep over all of this though. It does work passing well if not perfectly, and in the mean time I guess we really are "doing science" and not wasting too many cycles or KWH's.

My best to all -
ID: 41038 · Report as offensive
Tom Gutman

Send message
Joined: 20 Jul 00
Posts: 48
Credit: 219,500
RAC: 0
United States
Message 41153 - Posted: 29 Oct 2004, 7:40:04 UTC - in response to Message 41038.  

I've got results that have been sent in three days late. And accepted. Three hours late just isn't going to matter. I don't even know if the deadline time shown is in UTC or in your local time.

------- Tom Gutman
ID: 41153 · Report as offensive
Pepo
Volunteer tester
Avatar

Send message
Joined: 5 Aug 99
Posts: 308
Credit: 418,019
RAC: 0
Slovakia
Message 41161 - Posted: 29 Oct 2004, 8:55:09 UTC - in response to Message 41153.  

> I've got results that have been sent in three days late. And accepted. Three
> hours late just isn't going to matter. I don't even know if the deadline time
> shown is in UTC or in your local time.
>
It's hard to say because we're only 1 hour +1 hour DST away from UTC, but as I remember, I would say it is local time and also DST offset is taken into account when displaying the deadline time.

Peter
ID: 41161 · Report as offensive
Profile Paul D. Buck
Volunteer tester

Send message
Joined: 19 Jul 00
Posts: 3898
Credit: 1,158,042
RAC: 0
United States
Message 41190 - Posted: 29 Oct 2004, 12:24:50 UTC - in response to Message 41038.  

> BTW, I checked back on my doggiest machine which had been running close to the
> deadline and found one result that reported about 3 hours late and was still
> accepted. So bottom line I guess it's just the luck of the draw (or the
> scheduler) on those.

In part, see if the result is valid and it comes in bbefore the other results (especially the "canonical" result) are deleted, and you match the canonical result you will be awarded credit.
ID: 41190 · Report as offensive

Message boards : Number crunching : Deadline = Upload or Report to Scheduler?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.