Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Benchmark method

We compare Fastmash with GNU datamash on the same files and machine. The benchmark kit checks that their output matches before timing either program.

Each job runs in two rounds, with one warm-up and seven timed runs per program in each round. Program order alternates, and job order is shuffled between rounds. The tables show the mean of the two median elapsed times in milliseconds. Lower times are better.

Both programs read regular files with a warm file cache, use the C locale and write timed output to /dev/null. Temporary files use disk-backed storage. GNU datamash’s -s commands include the time taken by the system sort.

Machines

HostCPUSystem
LaptopIntel Core i7-8550UCachyOS, native Linux
DesktopAMD Ryzen 7 9800X3DCachyOS, native Linux

Data and commands

The benchmark kit downloads RefGene genome annotations and UCI Wine Quality measurements, and generates synthetic decimal tables from a fixed seed. The remaining jobs exercise small groups, a dominant group and a large sorted summary.

Field numbers in each command refer to its input table. The commands below are identical for both programs.

Job and argumentsIntel laptop, GNU → Fastmash (ms)AMD desktop, GNU → Fastmash (ms)
Exon-count quantiles (RefGene)
q1 9 median 9 q3 9 iqr 9
111.0 → 21.5 (5.16×)60.0 → 12.6 (4.76×)
Transcripts per gene (RefGene)
-s -g 13 count 2 collapse 2
110.8 → 73.0 (1.52×)57.0 → 37.9 (1.50×)
Exon statistics per gene (RefGene)
-s -g 13 count 9 min 9 max 9 mean 9 median 9
157.8 → 86.8 (1.82×)74.8 → 45.0 (1.66×)
Many small groups (genes)
-s -g 1 count 2 collapse 2
159.8 → 127.1 (1.26×)66.1 → 53.1 (1.24×)
Gene example (datamash manual)
-H -s -g 13 count 2
7.0 → 4.2 (1.67×)3.3 → 2.1 (1.57×)
Sum and mean, 1M decimals
-H sum 3 mean 3
325.4 → 87.5 (3.72×)114.8 → 37.2 (3.09×)
Sum and mean, 100k decimals
-H sum 3 mean 3
32.8 → 9.5 (3.45×)11.6 → 3.9 (2.97×)
Grouped decimals, 100k rows
-H -s -g 2 count 3 mean 3 median 3
68.1 → 38.7 (1.76×)27.5 → 18.0 (1.53×)
One dominant group
-s -g 1 count 2 collapse 2
21.6 → 9.1 (2.37×)9.3 → 3.9 (2.38×)
Wine quality by grade
-t ';' -H -s -g 12 count 1 mean 11 median 11
6.0 → 2.6 (2.31×)3.0 → 1.2 (2.50×)
Large sorted summary
-s -g 1 count 2 collapse 2
547.2 → 495.1 (1.11×)204.4 → 240.2 (0.85×)
White wine summary
-t ';' -H mean 9 median 9 min 9 max 9
4.2 → 1.9 (2.21×)1.7 → 0.9 (1.89×)