PC Pals Forum

Technical Help & Discussion => General Tech Discussion, News & Q&A => Topic started by: Simon on July 22, 2011, 19:45

Title: IBM scans ten billion files during your lunch hour
Post by: Simon on July 22, 2011, 19:45

IBM has unveiled a single system that can scan 10 billion files in only 43 minutes.

If that doesn't sound impressive, keep in mind IBM's last record was one billion files scanned in three hours in 2007.

IBM made the achievement with its General Parallel File System (GPFS) - commonly used by top supercomputers - running on a cluster of ten eight-core systems paired with 6.8 terabytes of solid-state storage.

"GPFS's advanced algorithm makes possible the full use of all processor cores on all of these machines in all phases of the task (data read, sorting and rules evaluation)," IBM explained.

"The appliances sustainably perform hundreds of millions of data input-output operations, while GPFS continuously identifies, selects and sorts the right set of files among the 10 billion on the system," IBM said.

The breakthrough makes it possible to hold huge amounts of data on a single platform, while keeping it manageable.

Read more: http://www.pcpro.co.uk/news/368830/ibm-scans-ten-billion-files-during-your-lunch-hour

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Rik on July 23, 2011, 06:05

I want one, I want one now!  ;D

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Simon on July 23, 2011, 11:10

I'd never heard of a 'Zettabyte'.  I wonder who thinks of the names of these, and how far they actually go up?

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Rik on July 23, 2011, 11:57

There's not many letters after Z... ;)

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Simon on July 23, 2011, 12:21

True.  :)

Title: Re: IBM scans ten billion files during your lunch hour
Post by: GillE on July 23, 2011, 13:50

Quote from: Rik on July 23, 2011, 11:57

There's not many letters after Z... ;)

Oh, I don't know.  On my keyboard there's xcvbnm,./

 ;D

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Simon on July 23, 2011, 14:13

:smartarse:

Title: Re: IBM scans ten billion files during your lunch hour
Post by: Rik on July 23, 2011, 14:56

 :laugh: