[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Help me explain --demux
From: |
Ole Tange |
Subject: |
Re: Help me explain --demux |
Date: |
Sat, 16 Feb 2019 00:30:43 +0100 |
On Fri, Feb 15, 2019 at 9:29 PM Achim Gratz <Stromeko@nexgo.de> wrote:
>
> Ole Tange writes:
> > I have implemented --demux.
> >
> > I need help explaining what this is and how to use it.
> >
> > --demultiplex or --demux splits out a stream of records and give each
> > record to a process based on the hash value of a column.
>
> The database community would call this "sharding".
True. Technically it is even closer to sharding than to demultiplexing.
I will rename --demux to --shard. And explain the column is the shard key.
At least the DB people might understand that, and others should be
able to look that up.
Good input. Thanks.
/Ole