skip navigation

How Fast is Düber?

Exact matching in Düber is almost instantaneous. Fuzzy matching, on the other hand, is a compute-intensive operation that becomes exponentially more expensive as the size of the list to be deduplicated grows longer.

Düber 2 contains a new, highly optimised fuzzy matching engine that accelerates the time taken to perform complex fuzzy matching deduplication tasks. The following table provides indicative fuzzy match deduplication times for typical list sizes. Note that actual times will depend on the data being matched and the speed of the machine being used.

Length of List Time to Dedupe
1,000 1 second
5,000 30 seconds
10,000 2 minutes
30,000 15 minutes