Recommended: System Errors? Click here to Fix your PC »
Deduplication (sometimes called Single-Instance Storage, Capacity Optimization orFactoring) is a data reduction technology intended to eliminate redundant(duplicate) data on a storage system by saving only one instance of each piece ofdata in order to reduce disk space and network bandwidth.
The are several types of deduplication technologies:- File deduplication. Only one copy of each identical file is stored. Thistechnology is also known as Single File Instance technology.- Data compression. Sometimes data compression is included as a deduplicationtechnology, however data deduplication differs from compression in that compressionlooks only for repeating patterns of information and reduces them. On the otherhand, data deduplication results in reducing the unique data regardless its internalformat. The typical reduction ratio of compression is x2 and the reduction ratio ofbyte level deduplication is x50.- Block level deduplication. Divides the information in blocks and only one copy ofeach identical block is stored.- Byte level deduplication. Analyzes the content of the information to bededuplicated at byte level and only stores the really unique data. This is the onlytechnology that guarantees full elimination of redundant data.
This means that different deduplication technologies can also provide differentgranular control, removing redundant portions of files, potentially down to theblock level or even to the byte level.
When evaluating a deduplication product, it's important to understand thegranularity offered by their platform.
Kondar deduplication technology.Basically Kondar deduplication technology is able to compare two blocks of data andfind the differences between them at byte level. The main feature of Kondar is thatitÂ's able to do this deduplication process with very large blocks of data, at bytelevel and very fast.
Kondar is data-format independent and can work with any kind of data: files, memorybuffers, disk images or data in streaming mode.
Here are just some examples to demonstrate the power and flexibility of Kondardeduplication technology:- Kondar can receive a stream with new data, compare it with other previously storeddata and create an output stream containing the data which is unique in the newstream. All of this is done at byte-level. This approach is also known asdelta-based caching deduplication.- Kondar can also work in a client/server architecture where it compares a newversion of a file or piece of data to be deduplicated (on the client) with theinitial version of that file (on the server), transferring only a minimal amount ofinformation to create a patch file on the server with the differences. This approachis very useful for data replication products.- Another variant of this approach is to store on the client a small file small fileinstantiating the initial version of a file or piece of data to be deduplicated anddo the comparison without having the initial file cached locally. Then the smallpatch file with the differences can be sent to a remote location. - Kondar can provide a Lortu proprietary file system API to create a data vault.Your products can send any kind of file to the Kondar component and Kondar willapply single-file instance and byte-level deduplication technology comparing all newfiles with all information stored so far in the vault. This approach guarantees thatthe vault holds only unique chunks of data.
Thanks to its byte level deduplication algorithms, Kondar can be used to achieve adata reduction ratio of between 10 and 100 times.
 Based on our philosophy of developing software components to be integrated intothird party companiesÂ' software or hardware products, Kondar is not a final productor a closed component. said Carlos Ardanza, CEO of Lortu Software.  Instead, Kondaris a technology that can provide the API that best suits our clients' products. Evenmore, we can fine-tune our technology in order to get the best performance andeasiest integration with your products.Â
Implementing WAN optimization and WAFS controllers with Kondar technology.
WAN optimization and WAFS controllers can benefit from Kondar technology becauseKondar can provide deduplication capabilities from data streams.
The process could be as follows:1- Kondar receives a stream with new data (incoming stream) from the host application.2- Kondar compares the incoming stream with the local cache previously stored.3- Kondar creates an output stream with the differences, which is sent to the remotecontroller.4- At the remote controller Kondar is able to restore the incoming stream from theoutput stream that was sent by the remote controller and the local cache.5- Finally Kondar adds the unique data (output stream) to the local cache of theremote controller. In this way, it wonÂ't be necessary to send this data through theWAN connection again.
All of this would be done at byte-level. This approach is also known as delta-basedcaching deduplication.
In those cases where the communication is one way, Kondar can deduplicate the streamwithout storing the local cache in the first controller. Kondar just needs to storea small file with some information about the remote controller cache in order tocompare the incoming stream with the remote cache. In this way, the local cache isonly required for the restoration process at the remote controller. This approachinvolves an important HD reduction, leading to price reductions and increasedcompetitiveness of products using Kondar technology.
 There are many other possibilities and we will be happy to discuss the bestapproach for each one of our clientsÂ' products. explains Alejandro Arostegui, SalesManager of Lortu Software.  For companies interested in implementing deduplicationtechnology in hardware, Kondar algorithms have been especially designed to beimplemented in FPGA, ASIC or proprietary multi-processor hardware where our clientscan take advantage of their parallelism and multithreading capabilities, providing agreat throughput and scalability grade.Â
About Lortu Software S.L.Lortu Software is a leading provider of byte-level delta deduplication technology,thanks to its proprietary Kondar component. Lortu is an advanced technology companydedicated to the development of technologies that can be integrated into third partyproducts and services. Lortu Software does not develop products for sale toend-users, but instead they license their technologies to other companies for thedevelopment and enhancement of their software or hardware products. Lortu Softwareis headquartered in Bilbao, Spain. For more information, please visithttp://www.lortu.com
F or More Information Contact:Lortu Software, S.L.Alejandro Arostegui MederosJuan de Ajuriaguerra, 9 - 6Â 48009 BILBAO, SPAIN Phone Number: +34 94 661 14 87 Fax: +34 94 424 50 30 E-mail: aarostegui@lortu.com
