bronwynrh: (birdie)
[personal profile] bronwynrh
So what do you do when your computer is busy tar'ing approximately 27 GB of data? You can't go home for the night, no. Someone might steal your laptop.

What, you're tired and hungry? Tough titties.

Oh well, I guess all you can do is go checkout the latest Strongbad e-mail. Then play the games at the end. Yep. I can feel the few brain cells I have left dying as we speak. I guess we won't be vacuuming the house tonight, will we?

Maybe I'll still be able to eat my leftovers for a late late dinner before crashing in bed to start all over at 6am tomorrow.

*tummy growl*

In other, brighter, better news. . . My Jeffrey is coming home tomorrow night!!! He leaves China at about midnight our time (that's Eastern right now, I think) and will get back to Louisville at 8:30 tomorrow night. I wish he were flying into Indy so I could pick him up and hug him and squeeze him and call him George.

Nope. I'll just have to wait until Wednesday to see him. Le sigh.

Edited to add: Went home, ate leftover spaghetti and garlic bread, smoothed over nicely with a glass of Pinot Grigio (Talus 2001 - very apple-y. Good, but not my favorite.). Fed my cats, who swore up and down that they were in danger of starving to death, and took a shower. Came back to find my tar.gz file is up to 8.64GB and still isn't finished.

Greeeeeeat.

So I'll sit here and listen to my music and try not to think about my love getting on a big ol' plane in just under 2 hours and wait. Wait wait wait.

(no subject)

Date: January 12th, 2004 11:19 pm (UTC)
From: [identity profile] platofish.livejournal.com

Why tar it? To transfer it to another computer?

(no subject)

Date: January 13th, 2004 05:52 am (UTC)
From: [identity profile] bramey.livejournal.com
yeppers. Tried WinZip, but it gorked on me with some pathetic excuse of size limitation.

So I went through the command line in telnet ftp, learned a whole new set of funky code, and tar'd.

It was the only way to get all this stuff over to the MDSS without ftp'ing one image at a time.

I'm new to this, but I'm suddenly the lab expert. I get to write up the protocol. *snort* As if I remember what the hell I did last night!

(no subject)

Date: January 13th, 2004 07:51 am (UTC)
From: [identity profile] platofish.livejournal.com

...MDSS, whassat?

Sounds like it took as long to tar as it would have to ftp individual images, longer in fact.

I don't know about that

Date: January 13th, 2004 08:23 am (UTC)
From: [identity profile] bramey.livejournal.com
Massive Data Storage Service. . . I think. Robots and tapes at IUB and IUPUI for big-stuff storage from the particle physicists and everything else.

There were many thousands of images to transfer. They were images from a confocal scope, so there were between 15-160 images per replicate, per strain, per replicate, per . . . I would have had to regenerate all the folders, or I would have just had a jumbled mess of images files, all with basically the same name.

So, I think the tar'ing was the better option. I only wish I'd known the compression capacity, because I sent a 10GB tar.gz file and then was told that it is better to send 2GB packages. Makes sense for easier downloading and such, but how am I supposed to know what size will yield a 2GB tar file?

I think you understand this stuff better than I do. I'm usually the one getting stuff done around here, but I'm often doing it blind.

Re: I don't know about that

Date: January 13th, 2004 08:41 am (UTC)
From: [identity profile] platofish.livejournal.com

how am I supposed to know what size will yield a 2GB tar file?

Depends on the compression algorith, and the data structure, but usually, I'd expect 10Gb to compress to around 5Gb.

We store the majority of our data ourselves on Firewire drives, or DVDs. Our experiment produces images files that vary between 10 and 35 Mb, at a rate of one every 5 seconds or so (a data set is usually around 2Gb+).

Backing it up onto a firewire drive (cost ~$250 for 250 Gb) takes a few minutes (firewire 2 transfers data at 800 Mb per second). Usually, I keep 2 copies, and if it was something super special, I'd also burn it ont a DVD (5Gb on each).

The big advantage - the drives are smaller than a paperback, and you retain your directory structure. Soon as you plug the drive in you have it, no untarring etc.


Re: I don't know about that

Date: March 2nd, 2004 06:33 pm (UTC)
From: [identity profile] bramey.livejournal.com
I was perusing my old entries and found this again. Gotta mention it to the boss-man.

:-)

Hope everything's good in your world. Got those pipes opened up?

Profile

bronwynrh: (Default)
bronwynrh

February 2012

S M T W T F S
   12 34
567891011
12131415161718
19202122232425
26272829   

Most Popular Tags

Style Credit

Expand Cut Tags

No cut tags
Page generated Feb. 6th, 2026 03:42 pm
Powered by Dreamwidth Studios