On TV.com: Is COMMUNITY or MODERN FAMILY better?
BNET Business Network:
BNET
TechRepublic
ZDNet

By John Borland
Posted on ZDNet News: Oct 6, 2004 11:00:00 AM

StreamCast Networks on Wednesday plans to release an updated version of its Morpheus file-swapping software, showcasing new search technology that could dramatically strengthen peer-to-peer networks.

Morpheus developers are looking to recapture their onetime leading role in the file-trading world with a network technology called Neonet, written by a pair of former Harvard students.

Dubbed "distributed hash tables," Neonet's technology transforms the way that searches happen on peer-to-peer networks, potentially making it more efficient to search a much larger number of computers and more easily surface rare files. Similar technology is also used by eDonkey, a competitor that is on the verge of overtaking Kazaa as the most widely used peer-to-peer service in the world.

News.context

What's new:
StreamCast is looking to recapture Morpheus' onetime leading role in the file-trading world with a new search technology called Neonet that could dramatically strengthen peer-to-peer networks.

Bottom line:
Neonet's technology transforms the way that searches happen on peer-to-peer networks, potentially making it easier to search a much larger number of computers and find rare files.

More stories on this topic

"Peer-to-peer technology to date is not good enough yet," said Michael Weiss, StreamCast's chief executive officer. "People ask, does the world really need another peer-to-peer network? I think the answer is, yes we do, because nobody's gotten it right yet."

The advances in peer-to-peer networking come as programmers are increasingly looking at using the technology most often associated with file trading for new applications such as Internet calling or instant messaging.

Even Internet service provider EarthLink recently released its own version of file-swapping software, saying that it was a prelude to more advanced applications such as Net phone calls.

Yet for most Net users, the draw of file swapping remains paramount. The threat of lawsuits from the Recording Industry Association of America--or even criminal investigations from the federal government--has dampened some swapping enthusiasm, but millions of people still download and use file-trading software every week.

Swapping's evolution
The release of Morpheus' software, along with eDonkey's rise, marks the ascent of a third generation of peer-to-peer networking technology. Each successive generation has decentralized more functions, making the networks harder to shut down and helping to expand the power of searches.

The first generation of file-swapping services, led by Napster, were built around big centralized indexes that would keep track of what was available everywhere on the network. These would serve as matchmakers, linking a person searching for a file with the computer where it was stored.

That was efficient, allowing access to a huge range of material--but it also proved to be illegal. Courts said that Napster was responsible for a network where a vast amount of copyright infringement was happening and ultimately shut the company down.

The second generation of decentralized services, led by Gnutella and the FastTrack technology underlying Kazaa, soon emerged to take its place. Neither of these had central servers. They relied instead on passing search requests from computer to computer until a file was found, and then passed that information back to the original searcher.

That technology proved initially unwieldy, as millions of search requests passed through every computer on the network, creating traffic jams at low-bandwidth bottleneck points. That improved over time as programmers figured out ways to hand off these search requests more efficiently, but usually resulted in searches that included only part of a network--say 100,000 people instead of 2 million.

A U.S Appeals Court recently ruled that this kind of decentralized network was legal, unlike Napster, in part because the software distributors did not have direct control over what was happening on the networks.

"The (record labels and movie studios) urge a re-examination of the law in the light of what they believe to be proper public policy," the court wrote in that decision. "Doubtless, taking that step would satisfy the copyright owners' immediate economic aims. However, it would also alter general copyright law in profound ways with unknown ultimate consequences outside the present context."

No more ripple effect
The third generation of networks, represented by eDonkey and now Morpheus, as well as a host of smaller independent developers, makes the tools even more decentralized than before.

Distributed hash tables are essentially a way of taking a snapshot of where every file on the network is at a given moment and scattering bits of that information around the entire network.

To find a given file, a search request goes first to any computer on the network. That computer will point to a different computer that has a little more information on how to find the file. The third computer might have information on the file itself--or it might take a few more hops to find the computer with the right information.

The process is analogous to asking a succession of increasingly informed tour guides for directions, rather than accosting random people on the street. The information about the network in each place is constantly being updated as new files or computers are added.

"The main benefit is that it allows you to search the entire network instead of just a local area," said Jed McCaleb, the chief programmer for the eDonkey project. "It's probably faster than the way Gnutella works, and it's definitely technically superior."

StreamCast acquired its technology last year from Harvard students Ben Wilkin and Francis Crick, the grandson of the DNA pioneer and Nobel prize-winner of the same name. Wilkin said he'd started the project after seeing early inefficiencies in Gnutella several years ago, while Crick joined the project later.

The pair says their technology will take just three or four hops to find any file, no matter how rare, on a network of up to millions of computers.

This kind of technology also holds promise for the newer applications such as Net calling. Neonet and eDonkey each are focused on file swapping, but the same efficient network routing could be used to connect calls quickly, even among computers that are constantly popping on and off the Net, they say.

"It can be used for all sorts of distributed computing tools, and that's where we're going to go with it," Wilken said. "It really eliminates the need to have any centralized infrastructure."

SponsoredWhite Papers, Webcasts, and Downloads

  • Talkback
  • Most Recent of 42 Talkback(s)
No_ax, you are offended?
Is this like your claim/post about running SaMBa on Windows (thrashed by no less than 6 people, each describing the network and filesharing protocols in detail)? Or perhaps your offended by people wh... (Read the rest)
Posted by: B.O.F.H. Posted on: 10/07/04 You are currently: a Guest | | Terms of Use
The next step  Roger Ramjet | 10/06/04
So your going to identify yourself then?  No_Ax_to_Grind | 10/06/04
More likely of the file contents..  d_jedi | 10/06/04
Read BOFH post...  No_Ax_to_Grind | 10/06/04
BOFH?  d_jedi | 10/06/04
BOFH defined  B.O.F.H. | 10/06/04
May not be possible to ID a single file...  Anton Philidor | 10/06/04
Another possibility..  d_jedi | 10/06/04
Partly usable  Roger Ramjet | 10/07/04
The web's technological advances...  Anton Philidor | 10/06/04
Pron is often a driving force  tic swayback | 10/06/04
How does a hash help?  No_Ax_to_Grind | 10/06/04
A hash function only provides a fast table index.  B.O.F.H. | 10/06/04
But...  No_Ax_to_Grind | 10/06/04
All they did was a dirtributed hash.  B.O.F.H. | 10/06/04
And all that is required to beat it...  No_Ax_to_Grind | 10/06/04
You keep trying, don't you?  B.O.F.H. | 10/06/04
You just endded the debate.  No_Ax_to_Grind | 10/06/04
I saw no insult, what are you talking about  voska | 10/06/04
voska: Your "opinion"..  No_Ax_to_Grind | 10/07/04
No_ax, you are offended?  B.O.F.H. | 10/07/04
What would the point of that be?  d_jedi | 10/06/04
Content providers would like it.  No_Ax_to_Grind | 10/06/04
OK, for destructive purposes..  d_jedi | 10/06/04
Not at all...  No_Ax_to_Grind | 10/06/04
Not really..  d_jedi | 10/06/04
Yeah, and all hackers live by the EULA...  No_Ax_to_Grind | 10/06/04
But if the RIAA is doing the hacking..  d_jedi | 10/06/04
RIAA doesn't need to do the hacking.  No_Ax_to_Grind | 10/07/04
Well, I guess you have a point..  d_jedi | 10/07/04
So the RIAA can violate provisions of the DMCA now?  B.O.F.H. | 10/07/04
Re: BOFH  d_jedi | 10/07/04
I read that Major Lables post new music on P2P  voska | 10/06/04
Same old problem, you can't trust all employees.  No_Ax_to_Grind | 10/06/04
Most likely..  d_jedi | 10/06/04
Some artists do it on purpose  tic swayback | 10/06/04
Good for them.  No_Ax_to_Grind | 10/06/04
Not after watching that TV show on this  voska | 10/06/04
Really..  d_jedi | 10/06/04
Never seen or heard of any such show.  No_Ax_to_Grind | 10/07/04
What would the point of that be?  d_jedi | 10/06/04
Again, sorry for the double post..  d_jedi | 10/06/04

What do you think?

advertisement

White Papers, Webcasts, and Downloads

SmartPlanet

Click Here