Skip to main content

📧 CLI to deduplicate mails from mail boxes.

Project description

Mail Deduplicate

Last release Python versions Unittests status Documentation status Coverage status DOI

What is Mail Deduplicate?

Provides the mdedup CLI, an utility to deduplicate mails from a set of boxes.

Mail Deduplicate

Features

  • Duplicate detection based on cherry-picked and normalized mail headers.
  • Fetch mails from multiple sources.
  • Reads and writes to mbox, maildir, babyl, mh and mmdf formats.
  • Deduplication strategies based on size, content, timestamp, file path or random choice.
  • Copy, move or delete the resulting set of duplicates.
  • Dry-run mode.
  • Protection against false-positives with safety checks on size and content differences.
  • Supports macOS, Linux and Windows.
  • Standalone executables for Linux, macOS and Windows.
  • Shell auto-completion for Bash, Zsh and Fish.

⚠️ Warning: Performances

mdedup implementation is quite naive at the moment and everything resides in memory.

If this is good enough for a volume of a couple of gigabytes, the more emails mdedup try to parse, the closer you'll reach the memory limits of your machine. In which case mdedup will exit abrubtly, zapped by the OOM killer of your OS. Of course your mileage may vary depending on your hardware.

You can influence implementation of this feature with pull requests, or purchase of business support 🤝 and sponsorship 🫶.

Example

Installation

From sources

Easiest way is to install mdedup from sources with pipx:

$ pipx install mail-deduplicate

Other alternatives installation methods are available in the documentation.

Executables

Standalone executables of mdedup's latest version are available for several platforms and architectures:

Platform x86_64
Linux Download mdedup-linux-x64.bin
macOS Download mdedup-macos-x64.bin
Windows Download mdedup-windows-x64.exe

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mail_deduplicate-7.2.3.tar.gz (28.0 kB view details)

Uploaded Source

Built Distribution

mail_deduplicate-7.2.3-py3-none-any.whl (39.2 kB view details)

Uploaded Python 3

File details

Details for the file mail_deduplicate-7.2.3.tar.gz.

File metadata

  • Download URL: mail_deduplicate-7.2.3.tar.gz
  • Upload date:
  • Size: 28.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.1 CPython/3.11.3

File hashes

Hashes for mail_deduplicate-7.2.3.tar.gz
Algorithm Hash digest
SHA256 bb998a9eb8f12e8f0d0b367458cdfd18183a61768270f7719f999d85ba2c6808
MD5 de9fc91c9071a105feed0b4c6cc963e6
BLAKE2b-256 faa2f4a3112f008d2da9081b0aabda11f52b80085c6626078497deb5c8fdb3b3

See more details on using hashes here.

File details

Details for the file mail_deduplicate-7.2.3-py3-none-any.whl.

File metadata

File hashes

Hashes for mail_deduplicate-7.2.3-py3-none-any.whl
Algorithm Hash digest
SHA256 790948965eb7059835fcbf8cacd1b3855b44c3f870dbf94e2253d28b15f8cfb2
MD5 512889edd8ff1d5525157cfcec59d134
BLAKE2b-256 193324e8ca27a0ca1da41e0e96aac31e4f6474a796ad0f6642f7896dc2d7c4cc

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page