Why are we doing the same work again?

Message boards : Number crunching : Why are we doing the same work again?
Message board moderation

To post messages, you must log in.

AuthorMessage
AdRoc

Send message
Joined: 3 Apr 99
Posts: 5
Credit: 10,443
RAC: 0
United States
Message 248361 - Posted: 15 Feb 2006, 3:53:31 UTC

Correct me if I'm wrong but it seems that we are crunching through work that has been previously done.

For example the following days a either being split or in the splitter queue. And according to calendar from the old seti site these days have already been distributed. I understand that this might be due to multiple tapes for a particular day (i.e. aa, ab, ac, etc) but this seems pretty unlikely to me.

Seti Calendar

28ja00aa
24ja00ab
16oc99aa
18oc99aa
16ja00aa
09no00aa
21ja01aa

Any thoughts?

-AdRoc
ID: 248361 · Report as offensive
Aurora Borealis
Volunteer tester
Avatar

Send message
Joined: 14 Jan 01
Posts: 3075
Credit: 5,631,463
RAC: 0
Canada
Message 248399 - Posted: 15 Feb 2006, 6:19:43 UTC - in response to Message 248361.  
Last modified: 15 Feb 2006, 6:21:02 UTC

Correct me if I'm wrong but it seems that we are crunching through work that has been previously done.

For example the following days a either being split or in the splitter queue. And according to calendar from the old seti site these days have already been distributed. I understand that this might be due to multiple tapes for a particular day (i.e. aa, ab, ac, etc) but this seems pretty unlikely to me.

Seti Calendar

28ja00aa
24ja00ab
16oc99aa
18oc99aa
16ja00aa
09no00aa
21ja01aa

Any thoughts?

-AdRoc

Tape usage is totally random. As has been said before, they just reach into a box of tapes and use whatever come up. There is no attempt to use recordings in any kind of order.

Also some of the tape that were put aside because at first look seem to contain mostly noise are being given a second screening and are sometime being used.

Boinc V7.2.42
Win7 i5 3.33G 4GB, GTX470
ID: 248399 · Report as offensive
Profile Sir Antony Magnus Project Donor
Avatar

Send message
Joined: 26 Dec 03
Posts: 66
Credit: 997,346
RAC: 1
United States
Message 248429 - Posted: 15 Feb 2006, 8:44:40 UTC

Redundancy I believe for this purpose is key to legitimizing the result itself. I believe this is why it is done, also suspect this will happen quite frequently now and in the future. Another reason may be the fact that with the influx of Classic users recently they have been running out of work. And also as Aurora Borealis put it.

Only my speculation here.

Antony Magnus
Ni newly returned, not newly knighted! Ni
ID: 248429 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21786
Credit: 7,508,002
RAC: 20
United Kingdom
Message 248481 - Posted: 15 Feb 2006, 13:58:45 UTC - in response to Message 248429.  
Last modified: 15 Feb 2006, 14:00:23 UTC

Redundancy I believe for this purpose is key to legitimizing the result itself. I believe this is why it is done, also suspect this will happen quite frequently now and in the future. Another reason may be the fact that with the influx of Classic users recently they have been running out of work. And also as Aurora Borealis put it.

Only my speculation here.

Speculation indeed...

Matt L (he whom grabs the tapes outa-da-box) has previously said that they have enough unlooked at tapes to keep everyone busy for a few months still. Certainly long enough to keep us all busy until seti-enhanced gets up and running. We can then look again at the existing data but with far greater sensitivity and slightly greater precision. Matt may rework the 'most interesting bits' first.

We then get various other telescope data sources coming online.

Berkeley's biggest headache at the moment is that:

1: They have run out of tapes for any new data!

2: They are down to their last one working tape drive!!!

Equipment and tape donations welcomed!

Happy crunchin',
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 248481 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 248504 - Posted: 15 Feb 2006, 15:50:03 UTC

Some facts:

1. We haven't recorded any new data in about a year.
2. We are now using tapes that have been in the system before, but for some reason or another (broken splitters, database corruption, etc.) they didn't yield very much science, if anything at all. There are about 90 of these tapes. At the current "burn rate" this will last about 6 weeks. With enhanced, a bit longer.
3. We hope to have the new data recorder on line soon.
4. It makes absolutely no scientific difference at all what order we put these tapes into the system. I don't have the time to sort these tapes by date. I'll let the database do all the time sorting for us when all the results are returned.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 248504 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21786
Credit: 7,508,002
RAC: 20
United Kingdom
Message 248514 - Posted: 15 Feb 2006, 16:21:46 UTC - in response to Message 248504.  
Last modified: 15 Feb 2006, 16:22:04 UTC

Some facts:

Thanks Matt for the update.

[...]
3. We hope to have the new data recorder on line soon.
[...]

How does the data get back to UCB when the new data recorder gets installed?

Has Arecibo now got a satellite link?!

Thanks,
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 248514 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 248569 - Posted: 15 Feb 2006, 18:03:00 UTC - in response to Message 248514.  

How does the data get back to UCB when the new data recorder gets installed?

Has Arecibo now got a satellite link?!


Nope.. Arecibo still has a slow but adequate connection to the world. So our data will continue to be shipped on DLT tapes, albeit 300GB tapes (as opposed to the current 35GB tapes). There is some discussion about using hard drives instead.

- Matt
-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 248569 · Report as offensive
Zap de Ridder
Volunteer tester

Send message
Joined: 9 Jan 00
Posts: 227
Credit: 1,468,844
RAC: 1
Netherlands
Message 248688 - Posted: 15 Feb 2006, 22:27:31 UTC

I'm pretty sure a few weeks or maybe a month ago someone offered a tape drive that was collecting dust an asked how to get it to Berkeley but I can'nt find the posting.
ID: 248688 · Report as offensive
Profile StokeyBob
Avatar

Send message
Joined: 31 Aug 03
Posts: 848
Credit: 2,218,691
RAC: 0
United States
Message 248717 - Posted: 15 Feb 2006, 23:45:11 UTC

ID: 248717 · Report as offensive
Astro
Volunteer tester
Avatar

Send message
Joined: 16 Apr 02
Posts: 8026
Credit: 600,015
RAC: 0
Message 248731 - Posted: 16 Feb 2006, 0:33:24 UTC

I think they were dlt40's, but I read that as well.
ID: 248731 · Report as offensive
Profile ML1
Volunteer moderator
Volunteer tester

Send message
Joined: 25 Nov 01
Posts: 21786
Credit: 7,508,002
RAC: 20
United Kingdom
Message 248742 - Posted: 16 Feb 2006, 1:03:50 UTC - in response to Message 248569.  

...There is some discussion about using hard drives instead.

- Matt

Those are cheapest and fast, but also the most fragile!

Copy the data onto multiple drives, pack very carefully for posting, and send the second copies some time later in a second parcel. Pack so that you can confidently kick them down four flights of stairs and prove that they always survive!

Regards,
Martin
See new freedom: Mageia Linux
Take a look for yourself: Linux Format
The Future is what We all make IT (GPLv3)
ID: 248742 · Report as offensive
Profile mikey
Volunteer tester
Avatar

Send message
Joined: 17 Dec 99
Posts: 4215
Credit: 3,474,603
RAC: 0
United States
Message 248763 - Posted: 16 Feb 2006, 1:58:23 UTC - in response to Message 248569.  

How does the data get back to UCB when the new data recorder gets installed?
Has Arecibo now got a satellite link?!

Nope.. Arecibo still has a slow but adequate connection to the world. So our data will continue to be shipped on DLT tapes, albeit 300GB tapes (as opposed to the current 35GB tapes). There is some discussion about using hard drives instead.- Matt

Matt did you see this thread? http://setiathome.berkeley.edu/forum_thread.php?id=28110
It says that Arecibo has a T3 line now.
ID: 248763 · Report as offensive
Profile Matt Lebofsky
Volunteer moderator
Project administrator
Project developer
Project scientist
Avatar

Send message
Joined: 1 Mar 99
Posts: 1444
Credit: 957,058
RAC: 0
United States
Message 248854 - Posted: 16 Feb 2006, 6:19:10 UTC - in response to Message 248763.  

Matt did you see this thread? http://setiathome.berkeley.edu/forum_thread.php?id=28110
It says that Arecibo has a T3 line now.


Right. I think roughly our new data rate would average about 32 Mbits/sec. A T3 could handle that, but.. well, yeah. You do the math.

Wow. I remember my first few years here working on SERENDIP. Back then (around 1997) the connection from Arecibo to the rest of the world was a single 56.6K modem. And I'd ssh over that along with everybody else. Painful.

- Matt

-- BOINC/SETI@home network/web/science/development person
-- "Any idiot can have a good idea. What is hard is to do it." - Jeanne-Claude
ID: 248854 · Report as offensive
Profile Jim-R.
Volunteer tester
Avatar

Send message
Joined: 7 Feb 06
Posts: 1494
Credit: 194,148
RAC: 0
United States
Message 248950 - Posted: 16 Feb 2006, 15:02:47 UTC - in response to Message 248742.  

...There is some discussion about using hard drives instead.

- Matt

Those are cheapest and fast, but also the most fragile!

Copy the data onto multiple drives, pack very carefully for posting, and send the second copies some time later in a second parcel. Pack so that you can confidently kick them down four flights of stairs and prove that they always survive!

Regards,
Martin


Multiple copies are a good idea, but a RAID array would be even better. With RAID (Redundant Array of Inexpensive Disks) the data is split onto three or more drives in such a way that if one of the disks were completely destroyed the data could be reconstructed from information stored on the other drives. Of course it takes at least three drives to contain what would be one drive full of data, but the data can be reconstructed on the fly, without waiting for a backup disk that could possibly get damaged too. And if the drives were shipped in individual boxes, the possibility of one of the drives getting misplaced/lost in shipment would not be a factor either. The number of permissible missing disks increases with the number of disks in the array. For example 5 disk arrays could loose two complete disks without error. Also even if the disks were damaged in shipment, there is a good possibility that the damage would not be the same on each disk, so if the disks were readable at all, the information could possibly be reconstructed from the non-damaged portions of each disk.
Jim

Some people plan their life out and look back at the wealth they've had.
Others live life day by day and look back at the wealth of experiences and enjoyment they've had.
ID: 248950 · Report as offensive
Profile Jim-R.
Volunteer tester
Avatar

Send message
Joined: 7 Feb 06
Posts: 1494
Credit: 194,148
RAC: 0
United States
Message 249458 - Posted: 17 Feb 2006, 20:25:07 UTC - in response to Message 248569.  

How does the data get back to UCB when the new data recorder gets installed?

Has Arecibo now got a satellite link?!


Nope.. Arecibo still has a slow but adequate connection to the world. So our data will continue to be shipped on DLT tapes, albeit 300GB tapes (as opposed to the current 35GB tapes). There is some discussion about using hard drives instead.

- Matt


How about a "cd" that can hold 100-200 gb! It's called "blueray" and they are supposed to be shipping single layer 25gb/disk systems shortly and a 2 layer disk has already been developed that will hold 50gb/disk. The disks can (in the fairly near future, they say) be increased to 8 layers, each holding 25gb of data for a total of 200gb on one cd/dvd style disk.
Jim

Some people plan their life out and look back at the wealth they've had.
Others live life day by day and look back at the wealth of experiences and enjoyment they've had.
ID: 249458 · Report as offensive
Profile Keck_Komputers
Volunteer tester
Avatar

Send message
Joined: 4 Jul 99
Posts: 1575
Credit: 4,152,111
RAC: 1
United States
Message 249781 - Posted: 18 Feb 2006, 10:58:44 UTC - in response to Message 249458.  

How about a "cd" that can hold 100-200 gb! It's called "blueray" and they are supposed to be shipping single layer 25gb/disk systems shortly and a 2 layer disk has already been developed that will hold 50gb/disk. The disks can (in the fairly near future, they say) be increased to 8 layers, each holding 25gb of data for a total of 200gb on one cd/dvd style disk.


This might be a good idea even with normal CD/DVD recordables. There would be less room per disk but with proper handling the data would not degrade over time.
BOINC WIKI

BOINCing since 2002/12/8
ID: 249781 · Report as offensive
Profile Mike Special Project $75 donor
Volunteer tester
Avatar

Send message
Joined: 17 Feb 01
Posts: 34591
Credit: 79,922,639
RAC: 80
Germany
Message 249787 - Posted: 18 Feb 2006, 11:18:13 UTC - in response to Message 249781.  

How about a "cd" that can hold 100-200 gb! It's called "blueray" and they are supposed to be shipping single layer 25gb/disk systems shortly and a 2 layer disk has already been developed that will hold 50gb/disk. The disks can (in the fairly near future, they say) be increased to 8 layers, each holding 25gb of data for a total of 200gb on one cd/dvd style disk.


This might be a good idea even with normal CD/DVD recordables. There would be less room per disk but with proper handling the data would not degrade over time.


Yes, indeed but we have to buy it then i think.

regards Mike

With each crime and every kindness we birth our future.
ID: 249787 · Report as offensive

Message boards : Number crunching : Why are we doing the same work again?


 
©2025 University of California
 
SETI@home and Astropulse are funded by grants from the National Science Foundation, NASA, and donations from SETI@home volunteers. AstroPulse is funded in part by the NSF through grant AST-0307956.