frafra/duperemove

Project ID: 3844

Description

This repository contains:

  • duperemove (v0.10)
  • xxhsum, libxxhash, libxxhash-devel (xxHash 0.6.2)

Duperemove

Duperemove is a simple tool for finding duplicated extents and submitting them for deduplication. When given a list of files it will hash their contents on a block by block basis and compare those hashes to each other, finding and categorizing extents that match each other. When given the -d option, duperemove will submit those extents for deduplication using the btrfs-extent-same ioctl.

!!! bedup is unmaintained, and does not use the safe deduplication ioctl. Use duperemove instead. !!!

Actually waiting for package review

xxhsum (xxHash)

xxHash is an Extremely fast Hash algorithm, running at RAM speed limits. It successfully completes the SMHasher test suite which evaluates collision, dispersion and randomness qualities of hash functions.

xxhsum code is used by duperemove, but the library is not shared yet

Actually waiting for package review

Installation Instructions

duperemove:

# dnf copr enable frafra/duperemove # dnf install duperemove

xxhsum:

# dnf copr enable frafra/duperemove # dnf install xxhsum

duperemove issues: github.com/markfasheh/duperemove/issues

xxhsum issues: github.com/Cyan4973/xxHash/issues

More information about BTRFS deduplication

Active Releases

The following unofficial repositories are provided as-is by owner of this project. Contact the owner directly for bugs or issues (IE: not bugzilla).

Release Architectures Repo Download
Epel for CentOS 7 x86_64 (0)* Epel for CentOS 7 (123 downloads)

* Total number of packages downloaded in the last seven days.