Benchmark: Filtering duplicates

Script Preparation code:


var array = [];
for (let i = 0; i < 100000; i++) {
    array.push({
        id: Math.floor((Math.random() * 10) + 1),
        name: 'name' + i
    });
}

Tests:

Set + filter
const seen = new Set(); const filtered = array.filter(el => { const duplicate = seen.has(el.id); seen.add(el.id); return !duplicate; });
Reduce
const filtered = array.reduce((acc, current) => { const x = acc.find(item => item.id === current.id); if (!x) { return acc.concat([current]); } else { return acc; } }, []);
Set
const filtered = Array.from(new Set(array.map(a => a.id))) .map(id => { return array.find(a => a.id === id) })

Rendered benchmark preparation results:

Suite status: <idle, ready to run>

Previous results

Test case name	Result
Set + filter
Reduce
Set

Fastest: N/A

Slowest: N/A

ⓘ Get performance results from real users on your website with Request Metrics.

Website Performance Monitoring by Request Metrics

Latest run results:

Run details: (Test run date: 9 months ago)

User agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36

Browser/OS: Chrome 114 on Linux

View result in a separate tab

Test name	Executions per second
Set + filter	527.2 Ops/sec
Reduce	528.9 Ops/sec
Set	493.0 Ops/sec

Filtering duplicates (version: 0)

Comparing performance of: Set + filter vs Reduce vs Set

Created: 9 months ago by: Guest

Jump to the latest result

Set + filter

Reduce

Set

Suite status: <idle, ready to run>

Experimental features:

Fastest: N/A

Slowest: N/A