Panic Mode On (91) Server Problems?

Message boards : Number crunching : Panic Mode On (91) Server Problems?
Message board moderation

To post messages, you must log in.

Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 21 · Next

AuthorMessage
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13753
Credit: 208,696,464
RAC: 304
Australia
Message 1595233 - Posted: 31 Oct 2014, 23:35:35 UTC - in response to Message 1595227.  

And the forums are loading slow - 30-60 sec. for each page.

Yep, and trying to view tasks just isn't possible. Page just won't load.
Grant
Darwin NT
ID: 1595233 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1595239 - Posted: 31 Oct 2014, 23:40:51 UTC - in response to Message 1595214.  

"HTTP service unavailable" or "Couldn't connect to server" appear to the current response to any Scheduler requests.

Scheduler reports do go through, sometimes:

31/10/2014 23:38:00 | SETI@home | sched RPC pending: Requested by user
31/10/2014 23:38:00 | SETI@home | [sched_op] Starting scheduler request
31/10/2014 23:38:00 | SETI@home | Sending scheduler request: Requested by user.
31/10/2014 23:38:00 | SETI@home | Reporting 2 completed tasks
31/10/2014 23:38:00 | SETI@home | Not requesting tasks: "no new tasks" requested via Manager
31/10/2014 23:38:00 | SETI@home | [sched_op] CPU work request: 0.00 seconds; 0.00 devices
31/10/2014 23:38:00 | SETI@home | [sched_op] NVIDIA GPU work request: 0.00 seconds; 0.00 devices
31/10/2014 23:38:00 | SETI@home | [sched_op] AMD/ATI GPU work request: 0.00 seconds; 0.00 devices
31/10/2014 23:38:43 | SETI@home | Scheduler request completed
31/10/2014 23:38:43 | SETI@home | [sched_op] Server version 705
31/10/2014 23:38:43 | SETI@home | Project requested delay of 303 seconds
31/10/2014 23:38:43 | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task ap_04ap11aa_B6_P1_00391_20141030_14171.wu_0
31/10/2014 23:38:43 | SETI@home | [sched_op] handle_scheduler_reply(): got ack for task ap_04ap11aa_B5_P0_00095_20141030_23464.wu_1
31/10/2014 23:38:43 | SETI@home | [sched_op] Deferring communication for 00:05:03
31/10/2014 23:38:43 | SETI@home | [sched_op] Reason: requested by project

Claggy
ID: 1595239 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1595240 - Posted: 31 Oct 2014, 23:42:24 UTC - in response to Message 1595233.  

And the forums are loading slow - 30-60 sec. for each page.

Yep, and trying to view tasks just isn't possible. Page just won't load.

That depends on how many tasks a host has, look at a host with just a few and it's O.K:

http://setiathome.berkeley.edu/results.php?hostid=5365373

Claggy
ID: 1595240 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1595248 - Posted: 31 Oct 2014, 23:50:44 UTC

Had I finally run my 11th APv7 with less than 10% blanking... now cache is empty.
ID: 1595248 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1595252 - Posted: 31 Oct 2014, 23:57:07 UTC - in response to Message 1595240.  

And the forums are loading slow - 30-60 sec. for each page.

Yep, and trying to view tasks just isn't possible. Page just won't load.

That depends on how many tasks a host has, look at a host with just a few and it's O.K:

http://setiathome.berkeley.edu/results.php?hostid=5365373

Claggy



Claggy, not quite true there. Even with a single task to be reported I am seeing "couldn't connect to server" or "HTTP internal server error" and that is across 4 machines.

It's been like this for a while (a bit on, a bit off).

The project is clagged mate, no pun intended.

If this is somehow related to a recent coding change I think they should unwind it.

cheers
ID: 1595252 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1595260 - Posted: 1 Nov 2014, 0:04:45 UTC - in response to Message 1595252.  
Last modified: 1 Nov 2014, 0:07:18 UTC

And the forums are loading slow - 30-60 sec. for each page.

Yep, and trying to view tasks just isn't possible. Page just won't load.

That depends on how many tasks a host has, look at a host with just a few and it's O.K:

http://setiathome.berkeley.edu/results.php?hostid=5365373

Claggy



Claggy, not quite true there. Even with a single task to be reported I am seeing "couldn't connect to server" or "HTTP internal server error" and that is across 4 machines.

It's been like this for a while (a bit on, a bit off).

The project is clagged mate, no pun intended.

If this is somehow related to a recent coding change I think they should unwind it.

cheers

That response was about viewing tasks pages, not whether scheduler contacts were going through.

It is entirely possible to view task pages of hosts that only have a few tasks, so the statement of 'Yep, and trying to view tasks just isn't possible. Page just won't load.' isn't true,
they are just slow to very slow, I can view my i5-3210M's task pages and the T8100's task pages without too much problem, the i7-2600K's task pages can be viewed too, But it takes a long time to load.

Claggy
ID: 1595260 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13753
Credit: 208,696,464
RAC: 304
Australia
Message 1595268 - Posted: 1 Nov 2014, 0:14:13 UTC - in response to Message 1595260.  

It is entirely possible to view task pages of hosts that only have a few tasks, so the statement of 'Yep, and trying to view tasks just isn't possible. Page just won't load.' isn't true,
they are just slow to very slow, I can view my i5-3210M's task pages and the T8100's task pages without too much problem, the i7-2600K's task pages can be viewed too, But it takes a long time to load.
Claggy

Going to my Account page, and clicking on tasks there- the page won't load. Going to each machine & trying to view tasks there, they will load- after 2-3 minutes of waiting.

It's borked again.
Grant
Darwin NT
ID: 1595268 · Report as offensive
Claggy
Volunteer tester

Send message
Joined: 5 Jul 99
Posts: 4654
Credit: 47,537,079
RAC: 4
United Kingdom
Message 1595275 - Posted: 1 Nov 2014, 0:19:37 UTC - in response to Message 1595268.  
Last modified: 1 Nov 2014, 0:21:40 UTC

It is entirely possible to view task pages of hosts that only have a few tasks, so the statement of 'Yep, and trying to view tasks just isn't possible. Page just won't load.' isn't true,
they are just slow to very slow, I can view my i5-3210M's task pages and the T8100's task pages without too much problem, the i7-2600K's task pages can be viewed too, But it takes a long time to load.
Claggy

Going to my Account page, and clicking on tasks there- the page won't load. Going to each machine & trying to view tasks there, they will load- after 2-3 minutes of waiting.

It's borked again.

Probably Carolyn's database, or Carolyn is under extreme pressure,

Looking at a result of a task is very fast, that's likely off Oscar (or is it the other way around?):

http://setiathome.berkeley.edu/result.php?resultid=3811856638

Claggy
ID: 1595275 · Report as offensive
Keith J. LaGue
Volunteer tester
Avatar

Send message
Joined: 17 May 99
Posts: 59
Credit: 40,441,387
RAC: 0
United States
Message 1595278 - Posted: 1 Nov 2014, 0:20:07 UTC

Beta site been down for well over an hour here. Haven't received stock ATI AP's since Wednesday.

Keifer
ID: 1595278 · Report as offensive
Profile cliff
Avatar

Send message
Joined: 16 Dec 07
Posts: 625
Credit: 3,590,440
RAC: 0
United Kingdom
Message 1595318 - Posted: 1 Nov 2014, 1:08:56 UTC

Hi Folks,
Had several failures to connect, and as many no tasks available for CPU and GPU..
Status page shows servers functioning, but no new tasks created if I read it aright..

So summats up again:-/ Weekend/Halloween blues?

Regards,
Cliff,
Been there, Done that, Still no damm T shirt!
ID: 1595318 · Report as offensive
Profile Jord
Volunteer tester
Avatar

Send message
Joined: 9 Jun 99
Posts: 15184
Credit: 4,362,181
RAC: 3
Netherlands
Message 1595323 - Posted: 1 Nov 2014, 1:13:25 UTC

Looks like they got the server problem fixed. Now if only there was work.

01/11/2014 02:11:43 | SETI@home | Requesting new tasks for AMD/ATI GPU
01/11/2014 02:11:43 | SETI@home | [sched_op] AMD/ATI GPU work request: 90720.00 seconds; 1.00 devices
01/11/2014 02:11:43 | SETI@home | [http] [ID#1] Info:  About to connect() to setiboinc.ssl.berkeley.edu port 80 (#19)
01/11/2014 02:11:43 | SETI@home | [http] [ID#1] Info:    Trying 208.68.240.20...
01/11/2014 02:11:44 | SETI@home | [http] [ID#1] Info:  Connected to setiboinc.ssl.berkeley.edu (208.68.240.20) port 80 (#19)
01/11/2014 02:11:49 | SETI@home | Scheduler request completed: got 0 new tasks
01/11/2014 02:11:49 | SETI@home | Project has no tasks available
01/11/2014 02:11:49 | SETI@home | Project requested delay of 303 seconds

ID: 1595323 · Report as offensive
Profile HAL9000
Volunteer tester
Avatar

Send message
Joined: 11 Sep 99
Posts: 6534
Credit: 196,805,888
RAC: 57
United States
Message 1595332 - Posted: 1 Nov 2014, 1:24:34 UTC

It looks like yesterday & today when the server went a bit wonky, fora, & other pages loaded slowly lines up with the time the stats were generated.

Are all of the results that have not been assimilated & purged bogging down the server? Perhaps there is some kind of odd fall out from the most recent hard crash?
SETI@home classic workunits: 93,865 CPU time: 863,447 hours
Join the [url=http://tinyurl.com/8y46zvu]BP6/VP6 User Group[
ID: 1595332 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13753
Credit: 208,696,464
RAC: 304
Australia
Message 1595339 - Posted: 1 Nov 2014, 1:52:45 UTC - in response to Message 1595332.  

It looks like there is plenty of work ready to go, the Scheduler just isn't handing it out.


APv6 WUs appear to be hanging around as well.
2,500 in progress, but with only 21 per hour being returned it's going to take a while to clear those.
Also there are 144,000 waiting for validation, and 40,000 waiting for assimilation.
Grant
Darwin NT
ID: 1595339 · Report as offensive
Profile Dimly Lit Lightbulb 😀
Volunteer tester
Avatar

Send message
Joined: 30 Aug 08
Posts: 15399
Credit: 7,423,413
RAC: 1
United Kingdom
Message 1595345 - Posted: 1 Nov 2014, 2:06:53 UTC - in response to Message 1595332.  

I've got completed and validated going back to the 3rd of October, something somewhere is a little stuck.

Member of the People Encouraging Niceness In Society club.

ID: 1595345 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1595371 - Posted: 1 Nov 2014, 2:27:57 UTC - in response to Message 1595345.  

I have 104 result trying to return. I keep getting the Http internal server error. It almost sounds like a rotating outage to certain areas of the world. I know that's not possible but maybe to certain host id numbers? Are they getting overwhelmed by return results that they need to limit when people send back their results?
ID: 1595371 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13753
Credit: 208,696,464
RAC: 304
Australia
Message 1595372 - Posted: 1 Nov 2014, 2:31:44 UTC - in response to Message 1595371.  

I have 104 result trying to return. I keep getting the Http internal server error. It almost sounds like a rotating outage to certain areas of the world. I know that's not possible but maybe to certain host id numbers? Are they getting overwhelmed by return results that they need to limit when people send back their results?

Nope, it's just general Scheduler weirdness.
Try setting your clients to No New Tasks, then manually reporting. Often that will work better than the usual report/request for more work.
Even so, the Scheduler is borked- all my Scheduler reports are going through, but no new work is being allocated. Network traffic has dropped way down to only a bit more than nothing.
Grant
Darwin NT
ID: 1595372 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1595374 - Posted: 1 Nov 2014, 2:34:59 UTC - in response to Message 1595372.  

Thanks Grant,

That got them reported. Wonder what it is causing these issues.


Zalster
ID: 1595374 · Report as offensive
tbret
Volunteer tester
Avatar

Send message
Joined: 28 May 99
Posts: 3380
Credit: 296,162,071
RAC: 40
United States
Message 1595378 - Posted: 1 Nov 2014, 2:39:40 UTC - in response to Message 1595374.  



Wonder what it is causing these issues.



A lack of neglect?
ID: 1595378 · Report as offensive
Profile Wiggo
Avatar

Send message
Joined: 24 Jan 00
Posts: 34964
Credit: 261,360,520
RAC: 489
Australia
Message 1595381 - Posted: 1 Nov 2014, 2:43:19 UTC

I see that we're having database problems again, thankfully I spent most of the morning here cleaning the winter dust bunnies out of both rigs.

Cheers.
ID: 1595381 · Report as offensive
Lionel

Send message
Joined: 25 Mar 00
Posts: 680
Credit: 563,640,304
RAC: 597
Australia
Message 1595414 - Posted: 1 Nov 2014, 4:47:52 UTC - in response to Message 1595381.  

Yep the projects knackered.
ID: 1595414 · Report as offensive
Previous · 1 . . . 4 · 5 · 6 · 7 · 8 · 9 · 10 . . . 21 · Next

Message boards : Number crunching : Panic Mode On (91) Server Problems?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.