From: Chris Rasch (crasch@openknowledge.org)
Date: Mon Apr 23 2001 - 10:26:20 MDT
-------- Original Message --------
Subject: OceanStore
Date: Mon, 23 Apr 2001 07:35:17 -0400
From: "R. A. Hettinga" <rah@shipwright.com>
To: Digital Bearer Settlement List <dbs@philodox.com>
http://interactive.wsj.com/articles/SB987971735549706483.htm
April 23, 2001
E-World
World's Largest Hard Drive
Can Save Every Scrap of Data
BERKELEY, CALIF. -- From budget spreadsheets to vacation photos, we're
all
piling up vast amounts of digital information. So where's the best place
to
keep it all? John Kubiatowicz, a professor at the University of
California
campus here, says the answer is easy: everywhere.
Mr. Kubiatowicz believes the way to protect information is to spread it
around. So he and a team of Berkeley researchers are developing
something
they call OceanStore, a global information storage system woven into the
Internet. They are essentially trying to build the world's largest hard
drive -- and then make it crash-proof.
Spurring them on is the trend toward pervasive computing. Losing your
Palm
or suffering a PC crash can be traumatic enough, but what happens when
smart devices are all over the place? Eventually, gadgets like personal
health monitors and smart cars could wind up churning out data. Mr.
Kubiatowicz wants to make sure all that information doesn't just
evaporate.
The approach faces huge technical hurdles, but it also raises big
questions
about information overload. Even if we can save every scrap of data,
should
we? How much reliability should we expect from our digital databanks?
And
once we figure out how to protect data from glitches and hackers, will
we
still be able to delete things when we want to?
OUR STANDARDS today, Mr. Kubiatowicz says, are simply too low. "People
are
resigned to losing information," says the 36-year-old computer science
professor, known as "Kubi" around the Berkeley campus. "That's
ridiculous."
He's right. Many of us treat the possibility of losing data as one of
the
costs of using technology. Corporations have gotten pretty good at
safeguarding central repositories like customer databases. But as
individuals, we're used to playing the odds. Sure, we know we should
back
up our important files more often. We should also eat less fat and work
out
more.
More reliable personal computers have diminished the risk, but the
growth
of digital information means there's more at stake. Hearing Mr.
Kubiatowicz
describe OceanStore, I found myself thinking about the hundreds of
digital
photos stored on my home PC -- mostly of my two-year-old daughter, Abby.
To
the PC those files are just ones and zeros, but to me they're priceless
memories. I realized I hadn't backed them up in weeks.
One way OceanStore would achieve reliability is redundancy. Files would
be
split into smaller, overlapping pieces before being scattered to servers
all over the network. Because the pieces would overlap, OceanStore could
reconstruct the original file using only a fraction of them. For
example,
Mr. Kubiatowicz says, a file divided into 64 overlapping chunks could be
rebuilt using just 16 fragments. If each of the original 64 pieces was
stored on a different server, you could knock out 48 OceanStore servers
without putting the original file at risk.
Join Tom Weber for a live discussion1 about OceanStore Monday at 2 p.m.
EDT. with Tom Weber and other WSJ.com readers
That kind of redundancy isn't entirely new. Corporate networks routinely
duplicate data on separate disk drives to guard against mishaps. What's
innovative about OceanStore is the notion that this level of protection
should be available to everyone, everywhere, for all kinds of data.
Thus, Mr. Kubiatowicz envisions your PC beaming its files to the
OceanStore
network over a cable or DSL Internet connection, while portable devices
such as a hand-held organizer or a digital camera might rely on wireless
connections. Devices would store and update files on OceanStore as soon
as
possible.
All of this would need to happen automatically, a feat that would make
the
synchronization between a Palm and a PC seem like child's play. Much of
that will depend on the continued growth of high-speed Internet
connections. And it will require proving to potential users that the
system
is both reliable and secure from hackers.
Receive e-mail notifying you of the latest publication of E-World. See
the
Personal Journal2 e-mail setup page for details on how to subscribe.
IT'S TEMPTING to dismiss big ideas like OceanStore as blue-sky dreams.
The
dot-com bubble gave us Internet time, the warp-speed development of
business ideas. Against that backdrop, Mr. Kubiatowicz's vision seems
closer to geological time. He and his researchers are seriously
evaluating
what it will take to preserve digital information for 1,000 years.
Who thinks in such terms anymore? The pace of digital culture makes
information seem like a disposable commodity, not something that
deserves
archival permanence. Yet today's random bytes may be tomorrow's family
heirloom or historical record.
The OceanStore approach is firmly in step with the direction of
computing.
Such "peer-to-peer" technology has taken a lot of abuse lately, but the
struggles of a few hastily launched start-ups don't alter the fact that
distributed, decentralized approaches offer benefits. The distributed
nature of the Internet itself is the ultimate proof.
You can e-mail Mr. Weber at tweber@wsj.com3 or visit the E-World Center4
.
The next step for OceanStore is to roll out a prototype network across a
number of university campuses. Mr. Kubiatowicz is thinking about a
business
model, too. He envisions it as a service you'd subscribe to, but one
operated by scores of companies. (IBM and EMC are already supporting his
research.)
How much information should we save in this brave new world? Keep it
all,
Mr. Kubiatowicz says. Computers, not people, will wind up dealing with
most
of it, he predicts. "Not too long from now, the fraction of information
that's never directly touched by humans will be huge," he says.
------------------------------------------------------------------------
URL for this Article:
http://interactive.wsj.com/archive/retrieve.cgi?id=SB987971735549706483.djm
Hyperlinks in this Article:
(1) http://interactive.wsj.com/documents/voices.html
(2)
http://interactive.wsj.com/user-cgi-bin/searchUser.pl?action=emailalert
(3) mailto:tweber@wsj.com
(4) http://interactive.wsj.com/articles/EWorldCenter.htm
------------------------------------------------------------------------
Copyright © 2001 Dow Jones & Company, Inc. All Rights Reserved.
Printing, distribution, and use of this material is governed by your
Subscription Agreement and copyright laws.
For information about subscribing, go to http://wsj.com
Close Window
-- ----------------- R. A. Hettinga <mailto: rah@ibuc.com> The Internet Bearer Underwriting Corporation <http://www.ibuc.com/> 44 Farquhar Street, Boston, MA 02131 USA "... however it may deserve respect for its usefulness and antiquity, [predicting the end of the world] has not been found agreeable to experience." -- Edward Gibbon, 'Decline and Fall of the Roman Empire'
This archive was generated by hypermail 2.1.5 : Sat Nov 02 2002 - 08:07:10 MST