Email this article   Print article 


Storage Dedupe Reaches The Mainstream

By Joseph F. Kovar
August 15, 2008    5:00 PM ET

Page 2 of 2

DEMYSTIFYING DEDUPE
Deduplication, also called "dedupe," removes duplicate information as data is backed up or archived. It can be done at the file level, where duplicate files are replaced with a marker pointing to one copy of the file, and/or at the subfile or byte level, where duplicate bytes of data are removed and replaced by pointers, resulting in a significant decrease in storage capacity requirements.

Dedupe products can be classified according to where the de-dupe process takes place. Source dedupe dedupes the data before it is sent across a LAN or WAN. Doing so results in fewer files and less data being sent over the network, but it can also affect the performance of the backup because of the processing overhead caused by the dedupe process.

Post-processing dedupe starts the dedupe process after the data is copied onto a destination device such as a virtual tape library. This mitigates the bottleneck by accepting the full data set and then eliminating duplicates as it is stored, but requires more storage capacity to temporarily store the entire data set.

In-line dedupe uses a separate appliance, which sits between the data source and the data target to dedupe the data as it is moved. This cuts the performance and capacity requirements, but adds a new appliance that needs to be managed.

<< Previous | 1 | 2

To continue reading this article, please download the free CRN Tech News app for your iPad or Windows 8 device.
Related: Videos | Slide Shows | Comments

SHARE THIS ARTICLE

More Storage

Recent Articles

10 Hot Products From EMC World To Hit The Storage Scene

Even thought there was nothing like the massive EMC 42-product release seen at the EMC World 2012, there was still enough new storage hardware and software unveiled at EMC World 2013 to make the visit worthwhile.

Storage, Security Products Take Center Stage At AWS Summit 2013

The AWS Summit 2013 conference will feature a wide range of solutions from vendors partnering with Amazon on improving the storage, movement, protection and security of data in the cloud.

5 Tech CEOs Under Pressure

These five CEOs are facing market uncertainty, falling stock prices, mediocre earnings or slumping sales. Can they weather the storms?

  More Slide Shows




Related Videos
Loading...