Re: [Gluster-devel] 3.4.0alpha3 performances

[Emmanuel Dreyfus]

Anand Avati <address@hidden> wrote:

> I'm wondering if this is because of the fsync() patch in AFR. Can you check
> if you are seeing similar perf fluctuations in a non-replicated volume?

It seems much faster. Here are the result so far. I will post an update later.

Brick: hangar:/export/vnd0a
---------------------------
Cumulative Stats:
   Block Size:               1024b+                2048b+                4096b+
 No. of Reads:                    0                     0                     0
No. of Writes:                    1                     1                     2
 
   Block Size:               8192b+               16384b+               32768b+
 No. of Reads:                    0                     0                     0
No. of Writes:                    5                     2                    47
 
   Block Size:              65536b+              131072b+ 
 No. of Reads:                    0                    65 
No. of Writes:                   78                  1159 
 %-latency   Avg-latency   Min-Latency   Max-Latency   No. of calls         Fop
 ---------   -----------   -----------   -----------   ------------        ----
      0.00       0.00 us       0.00 us       0.00 us           1727     RELEASE
      0.00      60.47 us      32.00 us     216.00 us             34      STATFS
      0.03    1127.82 us      25.00 us    8867.00 us             11       FSTAT
      0.12    2500.20 us     271.00 us   14200.00 us             20        READ
      0.15    3920.88 us      99.00 us   20410.00 us             16       WRITE
      2.24     657.38 us      52.00 us  255498.00 us           1413     SETATTR
      4.10    2578.57 us      49.00 us  208953.00 us            660   FTRUNCATE
      4.70   24092.91 us    9606.00 us   56360.00 us             81       MKDIR
      7.06    4435.32 us     300.00 us   74128.00 us            660       FSYNC
     10.16    6346.30 us    1473.00 us  178159.00 us            664      RENAME
     15.61    1426.32 us      49.00 us  262185.00 us           4542      LOOKUP
     55.82   34827.41 us   19510.00 us  370173.00 us            665      CREATE
 
    Duration: 209 seconds
   Data Read: 8519680 bytes
Data Written: 159207590 bytes
 
Interval 1 Stats:
   Block Size:               1024b+                2048b+                8192b+
 No. of Reads:                    0                     0                     0
No. of Writes:                    1                     1                     1
 
   Block Size:              32768b+               65536b+              131072b+
 No. of Reads:                    0                     0                    18
No. of Writes:                    5                     5                     0
 
 %-latency   Avg-latency   Min-Latency   Max-Latency   No. of calls         Fop
 ---------   -----------   -----------   -----------   ------------        ----
      0.00       0.00 us       0.00 us       0.00 us            443     RELEASE
      0.00      63.35 us      32.00 us     216.00 us             20      STATFS
      0.04    1335.00 us      25.00 us    8867.00 us              8       FSTAT
      0.18    3776.15 us      99.00 us   20410.00 us             13       WRITE
      0.18    2744.67 us     271.00 us   14200.00 us             18        READ
      2.80     818.98 us      52.00 us  255498.00 us            943     SETATTR
      4.64    2889.87 us      49.00 us  208953.00 us            442   FTRUNCATE
      4.87   23509.79 us   10116.00 us   49732.00 us             57       MKDIR
      7.21    4484.30 us     300.00 us   56846.00 us            443       FSYNC
     10.01    6239.40 us    1473.00 us  178159.00 us            442      RENAME
     15.79    1443.45 us      55.00 us  255467.00 us           3013      LOOKUP
     54.28   33823.68 us   19510.00 us  295720.00 us            442      CREATE
 
    Duration: 20 seconds
   Data Read: 2359296 bytes
Data Written: 667763 bytes
 
Brick: silo:/export/vnd0a
-------------------------
Cumulative Stats:
   Block Size:                  2b+                   4b+                   8b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   14                    20                    50
 
   Block Size:                 16b+                  32b+                  64b+
 No. of Reads:                    0                     0                     0
No. of Writes:                  198                   199                    51
 
   Block Size:                128b+                 256b+                 512b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   97                   127                   260
 
   Block Size:               1024b+                2048b+                4096b+
 No. of Reads:                    0                     0                     0
No. of Writes:                  247                   392                   190
 
   Block Size:               8192b+               16384b+               32768b+
 No. of Reads:                    0                     0                     0
No. of Writes:                  148                   149                   104
 
   Block Size:              65536b+              131072b+ 
 No. of Reads:                    0                    66 
No. of Writes:                   96                  1157 
 %-latency   Avg-latency   Min-Latency   Max-Latency   No. of calls         Fop
 ---------   -----------   -----------   -----------   ------------        ----
      0.00       0.00 us       0.00 us       0.00 us           1727     RELEASE
      0.01      97.52 us      33.00 us     659.00 us             31      STATFS
      0.09    2214.95 us     178.00 us   13524.00 us             20        READ
      0.11    5761.20 us      20.00 us   41315.00 us             10       FSTAT
      0.77     273.54 us      49.00 us   18969.00 us           1426     SETATTR
      1.35    8713.90 us    3466.00 us   33052.00 us             79    SETXATTR
      3.34   21291.04 us   10804.00 us   53328.00 us             80       MKDIR
      4.10    2516.93 us      26.00 us  172302.00 us            829       WRITE
      6.16    4957.96 us    1059.00 us  141002.00 us            633       FSYNC
      6.45    5195.89 us      45.00 us  188696.00 us            632   FTRUNCATE
     11.67    1375.47 us      59.00 us  255769.00 us           4320      LOOKUP
     11.70    9400.69 us    1500.00 us  386711.00 us            634      RENAME
     54.25   43712.48 us   23248.00 us  411301.00 us            632      CREATE
 
    Duration: 207 seconds
   Data Read: 8650752 bytes
Data Written: 169875331 bytes
 
Interval 1 Stats:
   Block Size:                  2b+                   4b+                   8b+
 No. of Reads:                    0                     0                     0
No. of Writes:                    1                     1                     7
 
   Block Size:                 16b+                  32b+                  64b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   49                    32                    10
 
   Block Size:                128b+                 256b+                 512b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   21                    23                    72
 
   Block Size:               1024b+                2048b+                4096b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   70                   142                    42
 
   Block Size:               8192b+               16384b+               32768b+
 No. of Reads:                    0                     0                     0
No. of Writes:                   42                    73                    21
 
   Block Size:              65536b+              131072b+ 
 No. of Reads:                    0                    17 
No. of Writes:                    7                     0 
 %-latency   Avg-latency   Min-Latency   Max-Latency   No. of calls         Fop
 ---------   -----------   -----------   -----------   ------------        ----
      0.00       0.00 us       0.00 us       0.00 us            443     RELEASE
      0.01     101.80 us      33.00 us     659.00 us             20      STATFS
      0.05    1155.71 us     178.00 us   10497.00 us             17        READ
      0.15    6848.88 us      20.00 us   41315.00 us              8       FSTAT
      0.87     321.40 us      49.00 us   18969.00 us           1000     SETATTR
      1.26    8166.32 us    3466.00 us   33052.00 us             57    SETXATTR
      3.37   21510.48 us   10804.00 us   53328.00 us             58       MKDIR
      4.42    2669.93 us      26.00 us  172302.00 us            613       WRITE
      6.15    5143.16 us    1111.00 us  141002.00 us            443       FSYNC
      6.36    5331.42 us      45.00 us  188696.00 us            442   FTRUNCATE
     11.37    1398.46 us      59.00 us  255769.00 us           3012      LOOKUP
     11.75    9825.16 us    1500.00 us  386711.00 us            443      RENAME
     54.27   45498.66 us   23248.00 us  411301.00 us            442      CREATE
 
    Duration: 20 seconds
   Data Read: 2228224 bytes
Data Written: 4203459 bytes

-- 
Emmanuel Dreyfus
http://hcpnet.free.fr/pubz
address@hidden