Dedup Icon

Dedup Review

Java command line utility to removes duplicate lines from text files.


Version:
1.5
Released:
24, June 2007
License:
Freeware
Size:
592 Kb
Rating:
1
10

0

Recommended: System Errors? Click here to Fix your PC »


Product Info

DeDup is a Java command-line utilty for removing duplicate
lines in text files.

The dedup process compares adjacent lines only. It does not
sort first. The comparison is case sensitive. It removes
adjacent indentical lines. It replaces the original file, so
do a backup first. You can dedup 1 to N files in one
execution, just put their names on the command line.

DeDup deletes blank lines from both the beginning and end of
the file. It also deletes trailing blanks from each line. It
also cleans up line terminators r n rn and converts them
all to platform standard. If the file is already deduped,
it does not change the date.

Use it with:

java com.mindprod.dedup.DeDup myfile.txt anotherfile.txt yetanotherfile.txt

or

java -jar dedup.jar myfile.txt anotherfile.txt yetanotherfile.txt

or, if you have the jar association set up, even even

dedup.jar myfile.txt anotherfile.txt yetanotherfile.txt

It can handle a list of files, or an os-expanded wildcard.
It does not -s to process subdirectories or the use of
directory names to process entire directories.

What's new in current version
add icon and pad file

Requirements
Java 1.1+

Please contact Dedup publisher, Canadian Mind Products if you have questions or issues regarding this product.
Awful
Poor
Average
Good
Excelent
 
Share Dedup Review, Removes duplicate lines from text files. Page  Share
Page URL: 
History Killer Pro Review History Killer Pro secures your online and offline privacy by removing dangerous and compromising files and cleaning PC collected trash info. Get control over the items that violates your privacy. History Killer Pro is your online privacy guarantee.
 
Featured downloads
Firefox Review The award-winning Firefox Web browser has security, speed and new features that will change the way you use the Web. Don’t settle for anything less
Ad-Aware 2008 Free Review The bottom line: Ad-Aware is your best option for keeping spyware and adware under control on your PC
Adobe Flash Player Review Flash Player is a cross-platform browser plug-in that delivers breakthrough Web experiences to over 98% of Internet users
Related downloads


DupeRAZOR - Duplicate Files Removal Kit from Urban Twilight Studios finds and removes duplicate files from your PC and helps to save precious disk space.

Duplicate File Finder Pro keeps your computer free of unnecessary files by finding and deleting duplicate files of your choice on your hard drives. You can for example set it to only find *.mp3 files in C:My music or files called backup.zip in D:

Duplicate Remover - easily Remove Duplicate Files, find duplicate files and delete duplicate files. Automatic duplicate remover - is a duplicate file remover to remove duplicate music and photos. Free download at DuplicateRemover.net

Extract lines that contain specified text in one or more PDF files. Extract lines that do not contain specified text. Extract text between specified starting and ending character(s) repeatedly throughout file(s). Save results as text files.

Extract lines that contain specified text from one or more files. Extract lines that do not contain specified text. Extract text between specified starting and ending character(s) repeatedly throughout file(s). Save results as text files.

Dupe Destroyer 5.2 removes duplicate entries from one or more wordlists very quick. These lists could contain passwords, E-Mail addresses, words from a dictionary, etc... All lists are processed in RAM, which causes a processing that is very fast.

LinesHelper finds and removes horizontal and vertical lines and repairs overlapping text and graphics on binary images.

Remove Duplicate Files - easily? Then you need automatic Duplicate File Remover. With such powerful Duplicate Remover as Remove Duplicate Files Easily, all your files will be cleared from duplicates. More info at RemoveDuplicateFiles.net

Duplicate files finder is designed to find and delete true duplicate files. This is one of the best comprehensive solution on the market. Duplicate files are usually waste and unnecessary,so keeping them is merely a waste of valuable hard disk space.

SurfStats FileFilter is a FREEWARE log file cleanup program that removes unwanted hit lines from log files. You can remove hit lines containing specified phrases, e.g. lines containing gif,jpg,cmd.exe, etc. and makes you log files smaller.
Related Press Releases
AJSystems announces a new utility for Outlook Express users - `OE Duplicate Message Remover`
AJSystems.com Inc.AJSystems announces a new utility for Outlook Express users - "OE Duplicate Message Remover".February 2006For Immediate ReleaseFor more information contact:Al Price, AJSystems.com Inc.167 Tweedsdale Cr., Oakville, Ontario, Canada L6L 4P6Phone: 905-847-9106 Fax: 514-371-7309Email
Killink CSV 1 1 Provides A Better Way to Create and Edit Delimited Text Files
FOR IMMEDIATE RELEASEPress Contact:Kirby TurnerWhite Peak Software IncPresidentinfo@whitepeakso ftware.comKillink CSV 1.1 Provides A Better Way to Create and Edit Delimited Text FilesSALEM, Massachusetts - May 10, 2007: White Peak Software announces the release andimmediate availability of Killink
eGrabber Announces Windows Vista and Office 2007 Support across Product Lines
Saratoga, CA, Apr 10, 2007 - eGrabber Inc., a leading SiliconValley-based provider of data-capture automation engines, today announced completesupport for Windows Vista and Office 2007 across its product lines. eGrabber'sproducts such as AddressGrabber, ListGrabber, ResumeGrabber, eMail-Lead
Recover huge hard-disk space by removing Duplicate Files!
When you install a new hard drive in your machine, or buy a newmachine, disk space seems almost unlimited. You start installing new programs,editing documents, downloading MP3s and suddenly, there's no more space. Part of itis, obviously, all the large files you've stored on the system,
DupKiller is powerful tool for searching and removing duplicate files
Here it is!DupKiller is the fastest and the most powerful tool for searching andremoving duplicate files. The program will find unneeded copies of files in thoselocations where you even would not consider to search. There is comparison not onlyby name, last modification date or size. One can compare
The Duplicate Content Debate
06/16/08 (Hayward, California) Article Marketer has recentlyreleased an e-book to address the hot debate surrounding the use of duplicatecontent as a viable means of internet marketing. Supporters tout its virtues whileopponents shout it down as a sure way to get a web site blacklisted by the searchengines.Somewhere
Free Internet System History Washer, Scans and removes traces of your computer
Free Internet/System History Washer scans and removes traces ofyour Internet and computing activity as well as delete a variety of junk files thatlitter your hard drive. It also wipes those files from your hard disk without thepossibility to recover them. Therefore, no one can see what you have been
New Article Submission Software Removes Pain Of Submitting Articles To Boost Website Traffic
FOR IMMEDIATE RELEASE01/17/2006January 17, 2006 -- Internet search engine professionals are unanimous in thelong-standing view that getting quality one-way incoming links to your web site isalmost sure to get a positive push in your web site ranking efforts and overallincreased targeted traffic.
Three multimedia product lines to download at Mediamorpher Center
(January 16, 2007)- Mediamorpher.com- Media Player DownloadCenter presents 4 lines of multimedia products for users to free download and enrichtheir high-tech tools collection. Details of the downloadable stuffs can be found athttp://www.mediamorpher.com /free-media-player-download.ht m. Media Morpher
Tinynice Txt2PDF - Convert ASCII text files to PDF on the fly! Fast, Compact and Batch processing
Convert your ASCII text files, for example, your text reportsand products specification into PDF documents for easier presentation, e-mailing,and sharing over the internet.Adobe's Portable Document Format (PDF) has become a de facto standard for electronicdocument interchange, based on its ability