Slow GPU tasks the last month or so?

Message boards : Number crunching : Slow GPU tasks the last month or so?
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Gish

Send message
Joined: 19 Aug 13
Posts: 9
Credit: 38,970,861
RAC: 115
United States
Message 1789136 - Posted: 21 May 2016, 3:46:53 UTC

Has anyone else been experiencing slow GPU tasks the last few weeks?
My GTX 970 was handling 3 tasks at a time, and only took 8-15 minutes per task to complete.
Now it's more like 45 minutes to an hour and a half per task, and it seems that my GPU is not being utilized to its potential as it was before.

For example, my GPU used to be at 65 degrees celcius and use ~ 85% VRAM when crunching, now it's at around 50C and ~35% VRAM.

Anyone having similar issues, or have any ideas as to what may be causing this?
ID: 1789136 · Report as offensive
Profile Zalster Special Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 27 May 99
Posts: 5517
Credit: 528,817,460
RAC: 242
United States
Message 1789141 - Posted: 21 May 2016, 3:54:37 UTC - in response to Message 1789136.  

You should read this thread

http://setiathome.berkeley.edu/forum_thread.php?id=79548

Green bank data has started to be sent to all GPUs. These are almost all VLAR work units.

As such they are much more complicated and take much longer on the GPUs.
ID: 1789141 · Report as offensive
Profile Gish

Send message
Joined: 19 Aug 13
Posts: 9
Credit: 38,970,861
RAC: 115
United States
Message 1789160 - Posted: 21 May 2016, 4:35:58 UTC - in response to Message 1789141.  

Thank you so much for the response! I was getting ready to RMA my card, because of the aforementioned symptoms, and my RAC falling.

Is it normal for these VLAR tasks to take between 1-4 hours?
ID: 1789160 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1789164 - Posted: 21 May 2016, 4:53:57 UTC - in response to Message 1789160.  

Thank you so much for the response! I was getting ready to RMA my card, because of the aforementioned symptoms, and my RAC falling.

Is it normal for these VLAR tasks to take between 1-4 hours?

Depending on the hardware, yes.
Grant
Darwin NT
ID: 1789164 · Report as offensive
Profile Gish

Send message
Joined: 19 Aug 13
Posts: 9
Credit: 38,970,861
RAC: 115
United States
Message 1789186 - Posted: 21 May 2016, 7:23:22 UTC - in response to Message 1789164.  

For a slightly overclocked GTX 970?

I have noticed my teams RAC slowly decreasing the past few weeks, though some members do not seem to be as affected as others.
ID: 1789186 · Report as offensive
Grant (SSSF)
Volunteer tester

Send message
Joined: 19 Aug 99
Posts: 13736
Credit: 208,696,464
RAC: 304
Australia
Message 1789189 - Posted: 21 May 2016, 7:37:20 UTC - in response to Message 1789186.  

For a slightly overclocked GTX 970?

Depends on how many WUs you do at a time & any other tweaks to the settings you might have done.


My GTX 750Tis generally do the Guppies in about 1hr 10min, running 2 at a time. Some WUs it does in under 44min, others can take almost 1hr 40min.
Grant
Darwin NT
ID: 1789189 · Report as offensive
Profile Gish

Send message
Joined: 19 Aug 13
Posts: 9
Credit: 38,970,861
RAC: 115
United States
Message 1789192 - Posted: 21 May 2016, 7:52:20 UTC - in response to Message 1789189.  

Typically running 3 WU's on it at a time, which now will vary from 1hr 30 min to 3 hours each.

My app_config looks like this: http://pastebin.com/dN076Z6s

I guess this seems somewhat normal, maybe a bit on the slower side.
ID: 1789192 · Report as offensive
kittyman Crowdfunding Project Donor*Special Project $75 donorSpecial Project $250 donor
Volunteer tester
Avatar

Send message
Joined: 9 Jul 00
Posts: 51468
Credit: 1,018,363,574
RAC: 1,004
United States
Message 1789242 - Posted: 21 May 2016, 13:51:32 UTC - in response to Message 1789186.  
Last modified: 21 May 2016, 13:52:06 UTC

For a slightly overclocked GTX 970?

I have noticed my teams RAC slowly decreasing the past few weeks, though some members do not seem to be as affected as others.

My team has been hit hard as well.
Those teams that have a high percentage of GPUs doing their work are taking the hit because of the poor performance of GPUs on VLAR Guppi tasks.
Teams which have a higher percentage of CPUs in their mix have not been hit as hard.

Meow.
"Freedom is just Chaos, with better lighting." Alan Dean Foster

ID: 1789242 · Report as offensive
Profile zoom3+1=4
Volunteer tester
Avatar

Send message
Joined: 30 Nov 03
Posts: 65749
Credit: 55,293,173
RAC: 49
United States
Message 1789324 - Posted: 21 May 2016, 19:12:13 UTC - in response to Message 1789189.  
Last modified: 21 May 2016, 19:14:01 UTC

For a slightly overclocked GTX 970?

Depends on how many WUs you do at a time & any other tweaks to the settings you might have done.


My GTX 750Tis generally do the Guppies in about 1hr 10min, running 2 at a time. Some WUs it does in under 44min, others can take almost 1hr 40min.

Here it's about 17 mins and about an 1h:23m for a guppy on the My fastest GTX 580, the PNY LC and yes I'm doing 2 at a time too.

I wish the Lunatics cuda42 was optimized for this, but I guess We'll all have to wait and see on that. Temps on Guppy here tend to be in the 50C's and on others around 62C. The card runs at 857MHz, which is stock for this card.

Oh and I am doing 4 wu's at a time on the i7 3820 cpu @ 3.81GHz, temps about 55C.
The T1 Trust, PRR T1 Class 4-4-4-4 #5550, 1 of America's First HST's
ID: 1789324 · Report as offensive

Message boards : Number crunching : Slow GPU tasks the last month or so?


 
©2024 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.