Monitoring inconclusive GBT validations and harvesting data for testing
Message boards :
Number crunching :
Monitoring inconclusive GBT validations and harvesting data for testing
Message board moderation
Previous · 1 . . . 6 · 7 · 8 · 9 · 10 · 11 · 12 . . . 36 · Next
| Author | Message |
|---|---|
|
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768 
 |
Pick one? OK, I choose this BLC2 that hasn't been run yet, http://setiathome.berkeley.edu/workunit.php?wuid=2249300998 Meanwhile here is the Non-SoG version. Which concurs with the Beta tests, the SoG version Doesn't work very well in Darwin 15.6. The Regular version is Much faster, but still gives Bad Results; KWSN-Darwin-MBbench v2.1.07
Running on TomsMacPro.local at Tue Aug 30 09:54:12 2016
---------------------------------------------------
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
reference_work_unit_r3215.wu
Listing executable(s) in /APPS :
MBv8_8.17r3516_NV_ssse3_x86_64-apple-darwin
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: reference_work_unit_r3215.wu
---------------------------------------------------
Skipping default app MBv8_8.05r3344_sse41_x86_64-apple-darwin, displaying saved result(s)
Elapsed Time: ………………………………… 2110 seconds
---------------------------------------------------
Running app with command : MBv8_8.17r3516_NV_ssse3_x86_64-apple-darwin
464.34 real 55.83 user 103.55 sys
Elapsed Time : ……………………………… 464 seconds
Speed compared to default : 454 %
-----------------
Comparing results
------------- R1:R2 ------------ ------------- R2:R1 ------------
Exact Super Tight Good Bad Exact Super Tight Good Bad
Spike 0 9 11 13 0 0 9 11 13 0
Autocorr 0 1 1 1 0 0 1 1 1 0
Gaussian 0 0 0 1 5 0 0 0 1 5
Pulse 0 0 0 0 0 0 0 0 0 2
Triplet 0 1 1 2 0 0 1 1 2 1
Best Spike 0 1 1 1 0 0 1 1 1 0
Best Autocorr 0 1 1 1 0 0 1 1 1 0
Best Gaussian 0 0 0 0 1 0 0 0 0 1
Best Pulse 0 0 0 0 1 0 0 0 0 1
Best Triplet 0 1 1 1 0 0 1 1 1 0
---- ---- ---- ---- ---- ---- ---- ---- ---- ----
0 14 16 20 7 0 14 16 20 10
Unmatched signal(s) in R1 at line(s) 499 526 580 607 634 694 720
Unmatched signal(s) in R2 at line(s) 482 509 526 569 595 649 676 703 763 789
For R1:R2 matched signals only, Q= 7.881%
Result : Weakly similar.
---------------------------------------------------ID: 1813749 ·  |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0 
|
I have archived another ~150 work units from both telescope sources. Feel free to download them and test. They are all located here, sorry for the folder structure of the drive, I'll try to make it tidier ID: 1813767 · |
|
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768
|
Now for the GUPPI Results using this WU, http://setiathome.berkeley.edu/workunit.php?wuid=2249300998 First the CPU Results which are very close to the Host running the AMD Ellesmere; Pulse: peak=0.8381211, time=45.82, period=0.846, d_freq=6222001021.41, score=1, chirp=-7.0343, fft_len=128 Spike: peak=24.31262, time=85.9, d_freq=6222002174.11, chirp=9.9486, fft_len=128k Spike: peak=24.83467, time=85.9, d_freq=6222002174.09, chirp=9.9524, fft_len=128k Spike: peak=25.85841, time=85.9, d_freq=6222002174.11, chirp=9.9537, fft_len=128k Spike: peak=24.77246, time=85.9, d_freq=6222002174.09, chirp=9.9575, fft_len=128k Spike: peak=26.00912, time=85.9, d_freq=6222002174.11, chirp=9.9588, fft_len=128k Spike: peak=24.69357, time=85.9, d_freq=6222002174.11, chirp=9.9638, fft_len=128k Pulse: peak=0.7050482, time=45.82, period=0.6538, d_freq=6222006366.61, score=1.005, chirp=12.059, fft_len=128 Pulse: peak=1.075337, time=45.84, period=1.293, d_freq=6222007930.82, score=1.032, chirp=28.139, fft_len=512 Triplet: peak=10.15056, time=29.08, period=20.4, d_freq=6222009544.38, chirp=-31.404, fft_len=2k Pulse: peak=1.037466, time=45.86, period=1.333, d_freq=6222004679.71, score=1.016, chirp=56.906, fft_len=1024 Pulse: peak=2.533699, time=45.82, period=4.414, d_freq=6222006327.97, score=1.082, chirp=-66.829, fft_len=256 Best spike: peak=26.00912, time=85.9, d_freq=6222002174.11, chirp=9.9588, fft_len=128k Best autocorr: peak=16.60604, time=62.99, delay=3.1172, d_freq=6222004751.66, chirp=12.94, fft_len=128k Best gaussian: peak=0, mean=0, ChiSq=0, time=-2.123e+11, d_freq=0, score=-12, null_hyp=0, chirp=0, fft_len=0 Best pulse: peak=2.533699, time=45.82, period=4.414, d_freq=6222006327.97, score=1.082, chirp=-66.829, fft_len=256 Best triplet: peak=10.15056, time=29.08, period=20.4, d_freq=6222009544.38, chirp=-31.404, fft_len=2k The OpenCL task found; Spike count: 6 Autocorr count: 0 Pulse count: 6 Triplet count: 1 Gaussian count: 0 TomsMacPro:KWSN-OSX-bench-MB_v2.1.07 Tom$ ./benchmark
KWSN-Darwin-MBbench v2.1.07
Running on TomsMacPro.local at Tue Aug 30 10:31:38 2016
---------------------------------------------------
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
Listing executable(s) in /APPS :
MBv8_8.17r3516_NV_ssse3_x86_64-apple-darwin
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
---------------------------------------------------
Running default app with command : MBv8_8.05r3344_sse41_x86_64-apple-darwin
4797.49 real 4788.79 user 7.25 sys
Elapsed Time: ………………………………… 4797 seconds
---------------------------------------------------
Running app with command : MBv8_8.17r3516_NV_ssse3_x86_64-apple-darwin
1345.67 real 131.03 user 213.86 sys
Elapsed Time : ……………………………… 1346 seconds
Speed compared to default : 356 %
-----------------
Comparing results
------------- R1:R2 ------------ ------------- R2:R1 ------------
Exact Super Tight Good Bad Exact Super Tight Good Bad
Spike 0 0 2 6 0 0 0 2 6 0
Autocorr 0 0 0 0 0 0 0 0 0 0
Gaussian 0 0 0 0 0 0 0 0 0 0
Pulse 0 0 0 5 0 0 0 0 5 1
Triplet 0 0 0 1 0 0 0 0 1 0
Best Spike 0 0 1 1 0 0 0 1 1 0
Best Autocorr 0 0 0 0 1 0 0 0 0 1
Best Gaussian 1 1 1 1 0 1 1 1 1 0
Best Pulse 0 0 0 1 0 0 0 0 1 0
Best Triplet 0 0 0 1 0 0 0 0 1 0
---- ---- ---- ---- ---- ---- ---- ---- ---- ----
1 1 4 16 1 1 1 4 16 2
Unmatched signal(s) in R1 at line(s) 608
Unmatched signal(s) in R2 at line(s) 592 636
For R1:R2 matched signals only, Q= 19.24%
Result : Weakly similar.
---------------------------------------------------The Older x41p_zi which has been modified to use the Blocking Sync reducing CPU use; Spike count: 6
Autocorr count: 0
Pulse count: 5
Triplet count: 1
Gaussian count: 0
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
Listing executable(s) in /APPS :
setiathome_x41p_zi_x86_64-apple-darwin_cuda75
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
---------------------------------------------------
Skipping default app MBv8_8.05r3344_sse41_x86_64-apple-darwin, displaying saved result(s)
Elapsed Time: ………………………………… 4797 seconds
---------------------------------------------------
Running app with command : setiathome_x41p_zi_x86_64-apple-darwin_cuda75
1027.35 real 167.86 user 36.61 sys
Elapsed Time : ……………………………… 1027 seconds
Speed compared to default : 467 %
-----------------
Comparing results
Result : Strongly similar, Q= 99.37%
---------------------------------------------------Not Bad... Hmmm... Spike count: 6
Autocorr count: 0
Pulse count: 5
Triplet count: 1
Gaussian count: 0
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
Listing executable(s) in /APPS :
setiathome_x41p_zi3e_x86_64-apple-darwin_cuda80
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
---------------------------------------------------
Skipping default app MBv8_8.05r3344_sse41_x86_64-apple-darwin, displaying saved result(s)
Elapsed Time: ………………………………… 4797 seconds
---------------------------------------------------
Running app with command : setiathome_x41p_zi3e_x86_64-apple-darwin_cuda80
888.96 real 104.42 user 18.42 sys
Elapsed Time : ……………………………… 889 seconds
Speed compared to default : 539 %
-----------------
Comparing results
Result : Strongly similar, Q= 99.37%
---------------------------------------------------Obviously one of the 50% or so of the current Alpha App tasks that validates on the first try. The other 50% or so are usually off by One Pulse. Not this one though. I'll have to see if I can round up a copy of the Stock OpenCL App and see how it does. ID: 1813786 · |
|
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768
|
Well, I didn't have a handy link to the App on Main. I did have one to the App on Beta though; Spike count: 6
Autocorr count: 0
Pulse count: 6
Triplet count: 1
Gaussian count: 0
Running on TomsMacPro.local at Tue Aug 30 14:02:54 2016
---------------------------------------------------
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
Listing executable(s) in /APPS :
setiathome_8.10_x86_64-apple-darwin__opencl_nvidia_mac
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
---------------------------------------------------
Skipping default app MBv8_8.05r3344_sse41_x86_64-apple-darwin, displaying saved result(s)
Elapsed Time: ………………………………… 4797 seconds
---------------------------------------------------
Running app with command : setiathome_8.10_x86_64-apple-darwin__opencl_nvidia_mac
1444.76 real 117.24 user 257.14 sys
Elapsed Time : ……………………………… 1444 seconds
Speed compared to default : 332 %
-----------------
Comparing results
------------- R1:R2 ------------ ------------- R2:R1 ------------
Exact Super Tight Good Bad Exact Super Tight Good Bad
Spike 0 0 2 6 0 0 0 2 6 0
Autocorr 0 0 0 0 0 0 0 0 0 0
Gaussian 0 0 0 0 0 0 0 0 0 0
Pulse 0 0 0 5 0 0 0 0 5 1
Triplet 0 0 0 1 0 0 0 0 1 0
Best Spike 0 0 1 1 0 0 0 1 1 0
Best Autocorr 0 0 0 0 1 0 0 0 0 1
Best Gaussian 1 1 1 1 0 1 1 1 1 0
Best Pulse 0 0 0 1 0 0 0 0 1 0
Best Triplet 0 0 0 1 0 0 0 0 1 0
---- ---- ---- ---- ---- ---- ---- ---- ---- ----
1 1 4 16 1 1 1 4 16 2
Unmatched signal(s) in R1 at line(s) 608
Unmatched signal(s) in R2 at line(s) 592 636
For R1:R2 matched signals only, Q= 19.24%
Result : Weakly similar.
---------------------------------------------------Not much different than r3516...only slower. I'm still pondering those Mac people at Beta. Running Apps that were released Apr 7th and don't stand a chance of making it to Main. Over and Over again. I don't think they are going to get any better. Too bad a few more of them aren't running the CUDA Apps, that actually give the correct results with the Current Mac OSX. BTW, if there is something wrong with the Compiler Options used on the App at Beta, Why hasn't it been changed since Apr 7th? Whatever. ID: 1813797 · |
 petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156 
 |
I have archived another ~150 work units from both telescope sources. Feel free to download them and test. They are all located here, sorry for the folder structure of the drive, I'll try to make it tidier Thank you! I haven't looked at the data that can be found inside the link. But, I'm glad to announce that with the help of one of your WU's I've been able to find one bug and fix it! As a developer I hope I can find a work unit and a valid result file (from standard CPU app) that I can compare against to. I work the days, I have a family, I need to sleep, and I have this wonderful hobby :) Petri To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1813870 · |
|
petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156
|
Hi, and yes. One bug fixed. It was a typo. I had accidentally deleted a "+2" from a calculation that affected rounding with integers that define one limit for pulse finding in one of the three cases it runs (num_adds == 5). TBar and jason_gee: please look at your emails. Thanks for Gianfranco for a quick response and a quick compilation. And since it is tuesday I'm waiting for the blackout. There was a short one, but that didn't last long. So where is the real outage? To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1813871 · |
jason_gee  Send message Joined: 24 Nov 06 Posts: 7489 Credit: 91,093,184 RAC: 0
|
updated in SVN, fingers crossed :). Guess the weekly outrage is late today ? Normally the project is offline at ~5am Wednesday morning for me, which is now. "Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions. ID: 1813897 · |
|
petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156
|
updated in SVN, fingers crossed :). Guess the weekly outrage is late today ? Normally the project is offline at ~5am Wednesday morning for me, which is now. A some very many thank You Jason. To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1813910 · |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0
|
I have archived another ~150 work units from both telescope sources. Feel free to download them and test. They are all located here, sorry for the folder structure of the drive, I'll try to make it tidier Here is the datafile and [url]here [/url=https://drive.google.com/open?id=0B4Qsq1o-u3XpOHY3b1hDRGpJTkU]is its associated valid cpu result Here is another datafile and cpu result file ID: 1813965 · |
|
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768
|
Ran the test again with the New setiathome_x41p_zi3f_x86_64-apple-darwin_cuda80. It seems to work about the same as the last version. I'll run it in BOINC now and see if it still misses a Pulse on about half the GUPPIs; KWSN-Darwin-MBbench v2.1.07
Running on TomsMacPro.local at Wed Aug 31 00:28:44 2016
---------------------------------------------------
Starting benchmark run...
---------------------------------------------------
Listing wu-file(s) in /testWUs :
blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
Listing executable(s) in /APPS :
setiathome_x41p_zi3e_x86_64-apple-darwin_cuda80 setiathome_x41p_zi3f_x86_64-apple-darwin_cuda80
Listing executable in /REF_APPs :
MBv8_8.05r3344_sse41_x86_64-apple-darwin
---------------------------------------------------
Current WU: blc2_2bit_guppi_57403_HIP11048_0006.17091.831.22.45.71.wu
---------------------------------------------------
Running default app with command : MBv8_8.05r3344_sse41_x86_64-apple-darwin
5654.28 real 5619.47 user 25.87 sys
Elapsed Time: ………………………………… 5654 seconds
---------------------------------------------------
Running app with command : setiathome_x41p_zi3e_x86_64-apple-darwin_cuda80 -bs -unroll 4
560.92 real 23.41 user 14.38 sys
Elapsed Time : ……………………………… 561 seconds
Speed compared to default : 1007 %
-----------------
Comparing results
Result : Strongly similar, Q= 99.37%
---------------------------------------------------
Running app with command : setiathome_x41p_zi3f_x86_64-apple-darwin_cuda80 -bs -unroll 4
556.17 real 23.31 user 14.27 sys
Elapsed Time : ……………………………… 556 seconds
Speed compared to default : 1016 %
-----------------
Comparing results
Result : Strongly similar, Q= 99.37%
---------------------------------------------------The last time the test was run without the cmdlines, this time the cmdlines were used. ID: 1814020 · |
|
Grant (SSSF) Send message Joined: 19 Aug 99 Posts: 13835 Credit: 208,696,464 RAC: 304
|
Speed compared to default : 1016 % Wow! Grant Darwin NT ID: 1814066 · |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0
|
OK just uploaded another 100 WU from both telescopes ID: 1814071 · |
|
jason_gee Send message Joined: 24 Nov 06 Posts: 7489 Credit: 91,093,184 RAC: 0
|
Speed compared to default : 1016 % Oh there's no doubt to me that Petri's work will make a massive mark. We manage to polish out the kinks, eventually a lot will trickle through to other devices/platforms as well. "Living by the wisdom of computer science doesn't sound so bad after all. And unlike most advice, it's backed up by proofs." -- Algorithms to live by: The computer science of human decisions. ID: 1814103 · |
|
TBar Send message Joined: 22 May 99 Posts: 5204 Credit: 840,779,836 RAC: 2,768
|
Hi, Congratulations Petri. That fix seems to have solved the major problems with the PulseFind. Very nice indeed! Since that cleared out the Inconclusive list, it's now easy to find those random Autocorrelation errors. I'm seeing them on both machines; Linux, http://setiathome.berkeley.edu/result.php?resultid=5128516321 OSX, http://setiathome.berkeley.edu/result.php?resultid=5126683290 Fortunately they seem to be few in number. Both machines seem to be much happier now. Thanks. ID: 1814162 · |
|
petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156
|
Hi, Thank you for testing. I'll be looking at the autocorr errors in weekend. I'd need a valid result file and the wu for those too. Petri To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1814165 · |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0
|
ID: 1814192 · |
|
petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156
|
Not sure what you want. But here is a datafile and results that I found had a few autocorr's in them Thank you Kiska, probably just those. Haven't had time to look in yet. I was referring to those that TBar found but I can do with your data too since thay have autocorr errors too. To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1814237 · |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0
|
Tbar, if you could, send me the datafile that has what petri has described and I'll run it on a stock Windows Intel app ID: 1814268 · |
|
Kiska Send message Joined: 31 Mar 12 Posts: 302 Credit: 3,067,762 RAC: 0
|
I've just uploaded another ~100 WU for archiving, also on that note these WU do not have corresponding result files, I will try to generate them sometime soon ID: 1814295 · |
|
petri33 Send message Joined: 6 Jun 02 Posts: 1668 Credit: 623,086,772 RAC: 156
|
Not sure what you want. But here is a datafile and results that I found had a few autocorr's in them @Kiska Hi, I downlaoded your WU and result file and I'm running a test on it now whth zi3f-version. I'll get back when I have done a result file comparison. To overcome Heisenbergs: "You can't always get what you want / but if you try sometimes you just might find / you get what you need." -- Rolling Stones ID: 1814329 · |
©2024 University of California
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.