[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: datamash performance question
|
From: |
Dima Kogan |
|
Subject: |
Re: datamash performance question |
|
Date: |
Fri, 25 Jun 2021 13:43:51 -0700 |
|
User-agent: |
mu4e 1.4.15; emacs 28.0.50 |
Jake VanEck <jake.vaneck@gmail.com> writes:
> I've tried similar commands but doesn't awk need to put the entire dataset
> into memory for this?
No. Absolutely not. It will read the input one line at a time, keeping
the running sums in memory, and it will write out the sums when the
input is exhausted.
If you care about performance, try out mawk specifically. It's a bit
snappier than other implementations.