Deduplication

Deduplication is the process of eliminating duplicates across a system:

• maintain consistency and correctness
• maximise storage efficiency
• reduce bandwidth

Some strategies that are used:

• Caching
• Idempotency keys
• Canonicalisation

See more info here.