Open Source data deduplication for less.
lessfs – A high performance inline data deduplicating filesystem for Linux.
Requirements
mhash fuse openssl
Download tokyocabinet
wget -c http://fallabs.com/tokyocabinet/tokyocabinet-1.4.47.tar.gz tar zxvf tokyocabinet-1.4.47.tar.gz cd tokyocabinet-1.4.47
Installation
./configure --enable-off64 make make install
Download lessfs
wget -c http://downloads.sourceforge.net/project/lessfs/lessfs/Lessfs-1.4.8/lessfs-1.4.8.tar.gz tar zxvf lessfs-1.4.8.tar.gz cd lessfs-1.4.8
Installation
./configure --with-crypto --with-lzo make make install
Preparation
mkdir -pv /data/mta mkdir -pv /data/dta cp ./etc/lessfs.cfg /etc/lessfs.cfg mklessfs -f -c /etc/lessfs.cfg lessfs /etc/lessfs.cfg /mnt/lessfs/
Testing
# df -h / /mnt/lessfs/ Filesystem Size Used Avail Use% Mounted on /dev/sda1 40G 9,9G 28G 27% / lessfs 40G 9,9G 28G 27% /mnt/lessfs
# du -h winxp_consoles_1.vmdk 1,5G winxp_consoles_1.vmdk
# cp winxp_consoles_1.vmdk /mnt/lessfs/
# df -h / /mnt/lessfs/ Filesystem Size Used Avail Use% Mounted on /dev/sda1 40G 11G 27G 29% / lessfs 40G 11G 27G 29% /mnt/lessfs
# cp winxp_consoles_1.vmdk /mnt/lessfs/winxp_consoles_1.vmdk2
# df -h / /mnt/lessfs/ Filesystem Size Used Avail Use% Mounted on /dev/sda1 40G 11G 27G 29% / lessfs 40G 11G 27G 29% /mnt/lessfs
# du -h /mnt/lessfs/* 1,5G /mnt/lessfs/winxp_consoles_1.vmdk 1,5G /mnt/lessfs/winxp_consoles_1.vmdk2