Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

FAQ

Is Fastmash a drop-in replacement for GNU datamash?

For most commands, yes: it accepts the same operations, options and selectors and aims to produce the same output. Check your scripts against Differences from GNU datamash, especially the locale settings and numerical last digits, and keep datamash installed while you compare.

Is it always faster?

Not yet. The published Linux benchmarks show Fastmash faster on many common jobs and slower on some others. Try it on your own data, and tell us about jobs where it is slower.

Why does Fastmash refuse my locale?

Some locales use sorting rules or numeric separators Fastmash does not support. Set LC_ALL=C.UTF-8 to use decimal points and byte ordering:

LC_ALL=C.UTF-8 fastmash -s -g 1 sum 2 < data.tsv

If you need language-specific ordering or decimal commas, see Locales for supported settings and limitations.

Can it read CSV files?

Yes. --csv-in reads strict quoted CSV, --csv-out encodes output fields, and --csv selects both. Quoted fields can contain commas, quotes and line breaks. Format switches do not infer headers. Aggregates, per-row operations, Top-N selection and dataset comparison support CSV, including their supported grouped workflows. Table health and legacy table/field modes remain ordinary-text only. -t, still means literal comma splitting, as in GNU datamash. See Quoted CSV and result names.

Can I check a table before calculating?

fastmash --header-in health < data.tsv reports inconsistent widths, missing values, mixed lexical types and examples. Add known rules such as type price number nonmissing id width 3 validate to fail on declared violations. Inferred findings stay advisory. A versioned TSV report is available for scripts. See Table health reports.

Can I compare two exports with different column orders?

Yes. With -H, named fields bind independently to each input header. fastmash -H -g category compare before.tsv after.tsv sum revenue reports each key’s before, after, signed difference and percentage, including added and removed keys. Keys consolidate across each whole dataset. They need not be adjacent. See Dataset comparison.

Can I use Fastmash in pipelines?

Yes. Fastmash reads standard input and writes results for the next program. Results written to a file or another program keep their plain data format.

Does sorting need another program?

No. Fastmash handles all sorting internally.

Why exit status 77?

Status 77 means Fastmash deliberately declined to produce a result: an unsupported feature, locale or condition, or a resource limit. It is distinct from status 1, which means the command or the input is wrong. See Errors, exit statuses and resources.

Why do results sometimes differ from GNU datamash in the last digit?

Fastmash computes with the same 80-bit precision, but in software, including its logarithms and exponentials. The same Fastmash version, input and settings give the same numerical results on every supported machine. GNU datamash’s results depend on the hardware and C library. See Portable results.

Does it work on macOS or Windows?

Yes. See the installation guide for native Windows and macOS requirements, downloads and setup. WSL2 remains available for Linux workflows.

How does Fastmash relate to GNU datamash?

Fastmash is an independent reimplementation of GNU datamash’s command language, written in Rust. It contains no GNU code and is not affiliated with the GNU Project. GNU datamash, by Assaf Gordon and contributors, defined the interface that Fastmash follows.