Re: [PATCH for-5.0 v2 0/3] benchmark util

[Vladimir Sementsov-Ogievskiy]

06.12.2019 22:43, Cleber Rosa wrote:
> On Tue, Nov 26, 2019 at 06:48:45PM +0300, Vladimir Sementsov-Ogievskiy wrote:
>> Hi all!
>>
>> Here is simple benchmarking utility, to generate performance
>> comparison tables, like the following:
>>
>> ----------  -------------  -------------  -------------
>>              backup-1       backup-2       mirror
>> ssd -> ssd  0.43 +- 0.00   4.48 +- 0.06   4.38 +- 0.02
>> ssd -> hdd  10.60 +- 0.08  10.69 +- 0.18  10.57 +- 0.05
>> ssd -> nbd  33.81 +- 0.37  10.67 +- 0.17  10.07 +- 0.07
>> ----------  -------------  -------------  -------------
>>
>> This is a v2, as v1 was inside
>>   "[RFC 00/24] backup performance: block_status + async"
>>
>> I'll use this benchmark in other series, hope someone
>> will like it.
>>
>> Vladimir Sementsov-Ogievskiy (3):
>>    python: add simplebench.py
>>    python: add qemu/bench_block_job.py
>>    python: add example usage of simplebench
>>
>>   python/bench-example.py        |  80 +++++++++++++++++++++
>>   python/qemu/bench_block_job.py | 115 +++++++++++++++++++++++++++++
>>   python/simplebench.py          | 128 +++++++++++++++++++++++++++++++++
>>   3 files changed, 323 insertions(+)
>>   create mode 100644 python/bench-example.py
>>   create mode 100755 python/qemu/bench_block_job.py
>>   create mode 100644 python/simplebench.py
>>
>> -- 
>> 2.18.0
>>
> 
> Hi Vladimir,
> 
> This looks interesting.
> 
> Do you think the execution of "test cases" in an "environment" are a
> generic enough concept that could be reused (or reuse other system)?

that was my goal: to make something generic enough, but simple. Yes,
it can be reused for anything

> My point is that it'd be nice to do the same thing say for the
> acceptance tests, or any tests for that matter.  For instance, for
> known parameters, we could record what's the time difference between
> booting a guest with q35 or pc machine types and virtio-block or
> virtio-scsi devices.
> 
> BTW, This reminded me of a IOzone[1] test runner / results analyzer:
> 
>    
> https://github.com/avocado-framework-tests/avocado-misc-tests/blob/master/io/disk/iozone.py
> 
> I'm also cc'ing Lukáš Doktor, who has actively worked in something
> similar.
> 
> Cheers,
> - Cleber.
> 


-- 
Best regards,
Vladimir