Panic Mode On (93) Server Problems?

Message boards : Number crunching : Panic Mode On (93) Server Problems?
Message board moderation

To post messages, you must log in.

1 · 2 · 3 · 4 . . . 24 · Next

AuthorMessage
Profile arkayn
Volunteer tester
Avatar

Send message
Joined: 14 May 99
Posts: 4438
Credit: 55,006,323
RAC: 0
United States
Message 1611132 - Posted: 9 Dec 2014, 4:28:11 UTC

AP is back, time to get those RAC's back up.

ID: 1611132 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1611164 - Posted: 9 Dec 2014, 6:39:14 UTC

Again we have 3 AP splitters working on another file together, 01jl11ad this time. :-(

Cheers.
ID: 1611164 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1611246 - Posted: 9 Dec 2014, 10:00:19 UTC

Well this is somewhat interesting. I was expecting that the huge surge in backlogged APs getting validated all of the sudden, RACs would explode 5-50x... but it seems to have not done that at all. Rather, at least from what I can see, it has gone back to roughly normal before the DB crashed in the first place. My host average--after being a flat line for 33 days--is now only down about 13% from what it was flat-lined at.

Just not the result I was expecting. I would guess third-party calculations will show a huge spike, but the project doesn't seem to be doing the same.

*shrug* Science is getting done though, and the credits don't matter in the grand scheme of things.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1611246 · Report as offensive
BetelgeuseFive Project Donor
Volunteer tester

Send message
Joined: 6 Jul 99
Posts: 158
Credit: 17,117,787
RAC: 19
Netherlands
Message 1611254 - Posted: 9 Dec 2014, 10:25:20 UTC - in response to Message 1611246.  

I had over 600 validated Astropulse tasks and I would have expected my credit to be up by at least 200K. However, it didn't even come close to that. It looks like the total credit has not (yet ?) been incremented by the sum of the credit for the validated tasks. Has anyone else noticed something similar ?

Tom
ID: 1611254 · Report as offensive
BetelgeuseFive Project Donor
Volunteer tester

Send message
Joined: 6 Jul 99
Posts: 158
Credit: 17,117,787
RAC: 19
Netherlands
Message 1611255 - Posted: 9 Dec 2014, 10:28:18 UTC - in response to Message 1611254.  

Oops, maybe it was not that bad. I forgot that there were a lot of tasks that had already been validated, but not yet been purged. However, I still think the increase in credit should have been a little higher.

Tom

I had over 600 validated Astropulse tasks and I would have expected my credit to be up by at least 200K. However, it didn't even come close to that. It looks like the total credit has not (yet ?) been incremented by the sum of the credit for the validated tasks. Has anyone else noticed something similar ?

Tom

ID: 1611255 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1611269 - Posted: 9 Dec 2014, 11:03:28 UTC

God Bless CreditNew:

9 Dec 2014, 5:06:05 UTC Completed and validated 5.34 1.05 490.39 AstroPulse v7 Anonymous platform (NVIDIA GPU)
ID: 1611269 · Report as offensive
Profile Julie
Volunteer moderator
Volunteer tester
Avatar

Send message
Joined: 28 Oct 09
Posts: 34053
Credit: 18,883,157
RAC: 18
Belgium
Message 1611290 - Posted: 9 Dec 2014, 11:24:52 UTC

Woohoo!! My RAC is climbing again! Just a quick question, will everything be alright with Bruno?
rOZZ
Music
Pictures
ID: 1611290 · Report as offensive
Admiral Gloval
Avatar

Send message
Joined: 31 Mar 13
Posts: 20232
Credit: 5,308,449
RAC: 0
United States
Message 1611306 - Posted: 9 Dec 2014, 13:19:49 UTC

I think my RAC got a swallow or two of "Red Bull". It is starting to fly up.

ID: 1611306 · Report as offensive
JohnDK Crowdfunding Project Donor*Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 28 May 00
Posts: 1222
Credit: 451,243,443
RAC: 1,127
Denmark
Message 1611352 - Posted: 9 Dec 2014, 16:04:15 UTC
Last modified: 9 Dec 2014, 16:04:46 UTC


Eric in news: Validators and assimilators and splitters are back on. New Astropulse work should be flowing soon.

How will it go...

Nom, nom, nom, feeding frenzy.

That is how it will go.... :-)

There's not much feeding frenzy going on, it's not easy getting APs and it's not because the demand is high. Looking at the cricket, the load isn't much higher compared with when there's was only MBs to download.
ID: 1611352 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1611367 - Posted: 9 Dec 2014, 16:22:19 UTC - in response to Message 1611352.  

Yeah, it's like 1 AP for every 30-40 MB coming out. Don't quote me on that number but looking at 300 download and only 17 were aps that is how it feels. Maybe it's just slow to get going?
ID: 1611367 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1611368 - Posted: 9 Dec 2014, 16:22:56 UTC - in response to Message 1611290.  

Woohoo!! My RAC is climbing again! Just a quick question, will everything be alright with Bruno?

Bruno has been or is going to be replace with a spare machine they acquired.
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1611368 · Report as offensive
Profile cliff
Avatar

Send message
Joined: 16 Dec 07
Posts: 625
Credit: 3,590,440
RAC: 0
United Kingdom
Message 1611405 - Posted: 9 Dec 2014, 23:24:12 UTC

@all,
well the gremlins are back:-(

09/12/2014 23:15:54 | SETI@home | Sending scheduler request: Requested by user.
09/12/2014 23:15:54 | SETI@home | Reporting 2 completed tasks
09/12/2014 23:15:54 | SETI@home | Requesting new tasks for NVIDIA GPU
09/12/2014 23:16:16 | SETI@home | Scheduler request failed: Couldn't connect to server
09/12/2014 23:16:30 | | Project communication failed: attempting access to reference site
09/12/2014 23:16:31 | | Internet access OK - project servers may be temporarily down.
09/12/2014 23:17:45 | SETI@home | Computation for task 10oc14aa.15931.3748.438086664200.12.58_2 finished
09/12/2014 23:17:45 | SETI@home | Starting task 20no14aa.15664.20926.438086664199.12.103_0
09/12/2014 23:17:48 | SETI@home | Started upload of 10oc14aa.15931.3748.438086664200.12.58_2_0
09/12/2014 23:17:52 | SETI@home | Finished upload of 10oc14aa.15931.3748.438086664200.12.58_2_0

1st no tasks available, stats 5 hrs behind due to maint, now when apparently tasks ARE to hand, the bleeding server aint..
Bah humbug..
Regards,
Cliff,
Been there, Done that, Still no damm T shirt!
ID: 1611405 · Report as offensive
Cruncher-American Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor

Send message
Joined: 25 Mar 02
Posts: 1513
Credit: 370,893,186
RAC: 340
United States
Message 1611410 - Posted: 9 Dec 2014, 23:41:11 UTC

Back with a vengeance - dead for the last 6 hours, I make it.
ID: 1611410 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1611411 - Posted: 9 Dec 2014, 23:45:06 UTC
Last modified: 9 Dec 2014, 23:45:36 UTC

Yes, there certainly are several different error messages being throw back at me here. :-(

Cheers.
ID: 1611411 · Report as offensive
Dena Wiltsie
Volunteer tester

Send message
Joined: 19 Apr 01
Posts: 1628
Credit: 24,230,968
RAC: 26
United States
Message 1611421 - Posted: 10 Dec 2014, 0:01:32 UTC

If you try looking at your task list, you will find it takes a while to pull up. In addition, the creation rate is far to low for even normal operation. It looks like something is locking the data base and the software needs a good kick to clear it.
ID: 1611421 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1611432 - Posted: 10 Dec 2014, 0:18:14 UTC - in response to Message 1611405.  
Last modified: 10 Dec 2014, 0:19:09 UTC

[snip]
1st no tasks available, stats 5 hrs behind due to maint, now when apparently tasks ARE to hand, the bleeding server aint..
Bah humbug..


I was seeing the same thing, then I remembered something that improved the odds back in the days before the co-lo:
2014-12-09 18:27:28 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:27:50 SETI@home Scheduler request failed: Couldn't connect to server
2014-12-09 18:35:50 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:36:12 SETI@home Scheduler request failed: Couldn't connect to server
2014-12-09 18:54:42 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:55:19 SETI@home Scheduler request failed: Failure when receiving data from the peer
2014-12-09 19:09:34 SETI@home Reporting 5 completed tasks, not requesting new tasks
2014-12-09 19:09:59 SETI@home Scheduler request completed
2014-12-09 19:15:04 SETI@home Requesting new tasks
2014-12-09 19:15:11 SETI@home Scheduler request completed: got 0 new tasks

So I got my tasks reported by going No New Tasks. After waiting 303 seconds, the scheduler responded normally.

edit: of course, 45 minutes is the span from start to finish on the above log snippets, and a lot can change in 45 minutes server-side. So maybe what I did.. didn't even matter. *shrug*
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1611432 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34744
Credit: 261,360,520
RAC: 489
Australia
Message 1611452 - Posted: 10 Dec 2014, 0:35:38 UTC - in response to Message 1611432.  

[snip]
1st no tasks available, stats 5 hrs behind due to maint, now when apparently tasks ARE to hand, the bleeding server aint..
Bah humbug..


I was seeing the same thing, then I remembered something that improved the odds back in the days before the co-lo:
2014-12-09 18:27:28 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:27:50 SETI@home Scheduler request failed: Couldn't connect to server
2014-12-09 18:35:50 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:36:12 SETI@home Scheduler request failed: Couldn't connect to server
2014-12-09 18:54:42 SETI@home Reporting 5 completed tasks, requesting new tasks
2014-12-09 18:55:19 SETI@home Scheduler request failed: Failure when receiving data from the peer
2014-12-09 19:09:34 SETI@home Reporting 5 completed tasks, not requesting new tasks
2014-12-09 19:09:59 SETI@home Scheduler request completed
2014-12-09 19:15:04 SETI@home Requesting new tasks
2014-12-09 19:15:11 SETI@home Scheduler request completed: got 0 new tasks

So I got my tasks reported by going No New Tasks. After waiting 303 seconds, the scheduler responded normally.

edit: of course, 45 minutes is the span from start to finish on the above log snippets, and a lot can change in 45 minutes server-side. So maybe what I did.. didn't even matter. *shrug*

I got my tasks reported 1st up, but now (even using that trick) just results in timeouts. :-(

Cheers.
ID: 1611452 · Report as offensive
Cosmic_Ocean
Avatar

Send message
Joined: 23 Dec 00
Posts: 3027
Credit: 13,516,867
RAC: 13
United States
Message 1611461 - Posted: 10 Dec 2014, 0:52:03 UTC - in response to Message 1611452.  

Still haven't gotten handed any new tasks after 4 more requests, but all the requests are completing properly. Looking at the cricket, it sure doesn't seem things are back up and running smoothly after the maintenance this time around.

Probably some DB query that is taking unusually long to run (purging many many many completed AP WUs, perhaps?).

I did see just after the data driven webpages came back up that for MB, "received in last hour" was nearly 200k.
Linux laptop:
record uptime: 1511d 20h 19m (ended due to the power brick giving-up)
ID: 1611461 · Report as offensive
Profile Jimbocous Project Donor
Volunteer tester
Avatar

Send message
Joined: 1 Apr 13
Posts: 1853
Credit: 268,616,081
RAC: 1,349
United States
Message 1611464 - Posted: 10 Dec 2014, 0:55:14 UTC - in response to Message 1611459.  

It's dead Jim, it's dead...

So it would seem, at least the SSP seems frozen, and trying to look at tasks takes you out into space.

Later, Jim ... (lol)
ID: 1611464 · Report as offensive
OTS
Volunteer tester

Send message
Joined: 6 Jan 08
Posts: 369
Credit: 20,533,537
RAC: 0
United States
Message 1611469 - Posted: 10 Dec 2014, 1:09:43 UTC - in response to Message 1611464.  
Last modified: 10 Dec 2014, 1:16:30 UTC

It's dead Jim, it's dead...

So it would seem, at least the SSP seems frozen, and trying to look at tasks takes you out into space.

Later, Jim ... (lol)


It might be back.

After several hours of

Scheduler request failed: HTTP internal server error

I am now seeing

Message from server: Project has no tasks available

Well, at least it is a start :)


Edit: Wishful thinking I guess. After three AP downloads it is back to

Scheduler request failed: HTTP internal server error

Another case of never call a no hitter
ID: 1611469 · Report as offensive
1 · 2 · 3 · 4 . . . 24 · Next

Message boards : Number crunching : Panic Mode On (93) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.