1k_block: (g=0): rw=read, bs=(R) 1024B-1024B, (W) 1024B-1024B, (T) 1024B-1024B, ioengine=psync, iodepth=1
4k_block: (g=1): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
1m_block: (g=2): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1
2m_block: (g=3): rw=read, bs=(R) 2048KiB-2048KiB, (W) 2048KiB-2048KiB, (T) 2048KiB-2048KiB, ioengine=psync, iodepth=1
4m_block: (g=4): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1
8m_block: (g=5): rw=read, bs=(R) 8192KiB-8192KiB, (W) 8192KiB-8192KiB, (T) 8192KiB-8192KiB, ioengine=psync, iodepth=1
16m_block: (g=6): rw=read, bs=(R) 16.0MiB-16.0MiB, (W) 16.0MiB-16.0MiB, (T) 16.0MiB-16.0MiB, ioengine=psync, iodepth=1
32m_block: (g=7): rw=read, bs=(R) 32.0MiB-32.0MiB, (W) 32.0MiB-32.0MiB, (T) 32.0MiB-32.0MiB, ioengine=psync, iodepth=1
fio-3.39
Starting 8 processes

1k_block: (groupid=0, jobs=1): err= 0: pid=310156: Mon Apr 14 08:12:27 2025
  read: IOPS=61.9k, BW=60.5MiB/s (63.4MB/s)(64.0MiB/1058msec)
    clat (usec): min=9, max=828, avg=15.88, stdev= 6.29
     lat (usec): min=9, max=828, avg=15.92, stdev= 6.29
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   15], 10.00th=[   15], 20.00th=[   15],
     | 30.00th=[   15], 40.00th=[   15], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   16], 80.00th=[   17], 90.00th=[   18], 95.00th=[   24],
     | 99.00th=[   25], 99.50th=[   25], 99.90th=[   67], 99.95th=[  137],
     | 99.99th=[  176]
   bw (  KiB/s): min=62446, max=62446, per=100.00%, avg=62446.00, stdev= 0.00, samples=1
   iops        : min=62446, max=62446, avg=62446.00, stdev= 0.00, samples=1
  lat (usec)   : 10=3.78%, 20=89.12%, 50=6.87%, 100=0.15%, 250=0.07%
  lat (usec)   : 500=0.01%, 1000=0.01%
  cpu          : usr=3.12%, sys=8.33%, ctx=65539, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=65536,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
4k_block: (groupid=1, jobs=1): err= 0: pid=310157: Mon Apr 14 08:12:27 2025
  read: IOPS=61.4k, BW=240MiB/s (251MB/s)(64.0MiB/267msec)
    clat (usec): min=10, max=893, avg=15.99, stdev=11.09
     lat (usec): min=10, max=893, avg=16.02, stdev=11.09
    clat percentiles (usec):
     |  1.00th=[   11],  5.00th=[   12], 10.00th=[   13], 20.00th=[   13],
     | 30.00th=[   13], 40.00th=[   13], 50.00th=[   13], 60.00th=[   13],
     | 70.00th=[   14], 80.00th=[   15], 90.00th=[   26], 95.00th=[   38],
     | 99.00th=[   49], 99.50th=[   50], 99.90th=[   67], 99.95th=[  133],
     | 99.99th=[  182]
  lat (usec)   : 20=83.81%, 50=15.75%, 100=0.38%, 250=0.05%, 1000=0.01%
  cpu          : usr=2.63%, sys=8.27%, ctx=16384, majf=0, minf=8
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=16384,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
1m_block: (groupid=2, jobs=1): err= 0: pid=310160: Mon Apr 14 08:12:27 2025
  read: IOPS=2000, BW=2000MiB/s (2097MB/s)(64.0MiB/32msec)
    clat (usec): min=372, max=1191, avg=494.23, stdev=91.47
     lat (usec): min=372, max=1191, avg=494.31, stdev=91.49
    clat percentiles (usec):
     |  1.00th=[  371],  5.00th=[  461], 10.00th=[  461], 20.00th=[  469],
     | 30.00th=[  474], 40.00th=[  478], 50.00th=[  482], 60.00th=[  490],
     | 70.00th=[  494], 80.00th=[  502], 90.00th=[  515], 95.00th=[  523],
     | 99.00th=[ 1188], 99.50th=[ 1188], 99.90th=[ 1188], 99.95th=[ 1188],
     | 99.99th=[ 1188]
  lat (usec)   : 500=79.69%, 750=18.75%
  lat (msec)   : 2=1.56%
  cpu          : usr=0.00%, sys=6.45%, ctx=64, majf=0, minf=262
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=64,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
2m_block: (groupid=3, jobs=1): err= 0: pid=310161: Mon Apr 14 08:12:27 2025
  read: IOPS=1280, BW=2560MiB/s (2684MB/s)(64.0MiB/25msec)
    clat (usec): min=642, max=979, avg=763.00, stdev=45.56
     lat (usec): min=642, max=980, avg=763.10, stdev=45.58
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  725], 10.00th=[  750], 20.00th=[  758],
     | 30.00th=[  758], 40.00th=[  758], 50.00th=[  758], 60.00th=[  766],
     | 70.00th=[  766], 80.00th=[  766], 90.00th=[  766], 95.00th=[  783],
     | 99.00th=[  979], 99.50th=[  979], 99.90th=[  979], 99.95th=[  979],
     | 99.99th=[  979]
  lat (usec)   : 750=6.25%, 1000=93.75%
  cpu          : usr=0.00%, sys=4.17%, ctx=32, majf=0, minf=518
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=32,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
4m_block: (groupid=4, jobs=1): err= 0: pid=310162: Mon Apr 14 08:12:27 2025
  read: IOPS=695, BW=2783MiB/s (2918MB/s)(64.0MiB/23msec)
    clat (usec): min=1326, max=2065, avg=1403.20, stdev=176.93
     lat (usec): min=1326, max=2065, avg=1403.32, stdev=177.04
    clat percentiles (usec):
     |  1.00th=[ 1319],  5.00th=[ 1319], 10.00th=[ 1352], 20.00th=[ 1352],
     | 30.00th=[ 1352], 40.00th=[ 1352], 50.00th=[ 1352], 60.00th=[ 1369],
     | 70.00th=[ 1369], 80.00th=[ 1369], 90.00th=[ 1385], 95.00th=[ 2073],
     | 99.00th=[ 2073], 99.50th=[ 2073], 99.90th=[ 2073], 99.95th=[ 2073],
     | 99.99th=[ 2073]
  lat (msec)   : 2=93.75%, 4=6.25%
  cpu          : usr=0.00%, sys=4.55%, ctx=17, majf=0, minf=520
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=16,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
8m_block: (groupid=5, jobs=1): err= 0: pid=310163: Mon Apr 14 08:12:27 2025
  read: IOPS=363, BW=2909MiB/s (3050MB/s)(64.0MiB/22msec)
    clat (usec): min=2545, max=3297, avg=2648.25, stdev=262.22
     lat (usec): min=2545, max=3297, avg=2648.38, stdev=262.28
    clat percentiles (usec):
     |  1.00th=[ 2540],  5.00th=[ 2540], 10.00th=[ 2540], 20.00th=[ 2540],
     | 30.00th=[ 2540], 40.00th=[ 2540], 50.00th=[ 2540], 60.00th=[ 2573],
     | 70.00th=[ 2573], 80.00th=[ 2573], 90.00th=[ 3294], 95.00th=[ 3294],
     | 99.00th=[ 3294], 99.50th=[ 3294], 99.90th=[ 3294], 99.95th=[ 3294],
     | 99.99th=[ 3294]
  lat (msec)   : 4=100.00%
  cpu          : usr=4.76%, sys=0.00%, ctx=8, majf=0, minf=522
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=8,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
16m_block: (groupid=6, jobs=1): err= 0: pid=310164: Mon Apr 14 08:12:27 2025
  read: IOPS=190, BW=3048MiB/s (3196MB/s)(64.0MiB/21msec)
    clat (usec): min=4946, max=5717, avg=5146.10, stdev=380.86
     lat (usec): min=4946, max=5717, avg=5146.43, stdev=380.85
    clat percentiles (usec):
     |  1.00th=[ 4948],  5.00th=[ 4948], 10.00th=[ 4948], 20.00th=[ 4948],
     | 30.00th=[ 4948], 40.00th=[ 4948], 50.00th=[ 4948], 60.00th=[ 4948],
     | 70.00th=[ 4948], 80.00th=[ 5735], 90.00th=[ 5735], 95.00th=[ 5735],
     | 99.00th=[ 5735], 99.50th=[ 5735], 99.90th=[ 5735], 99.95th=[ 5735],
     | 99.99th=[ 5735]
  lat (msec)   : 10=100.00%
  cpu          : usr=0.00%, sys=5.00%, ctx=4, majf=0, minf=525
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=4,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1
32m_block: (groupid=7, jobs=1): err= 0: pid=310165: Mon Apr 14 08:12:27 2025
  read: IOPS=90, BW=2909MiB/s (3050MB/s)(64.0MiB/22msec)
    clat (usec): min=10075, max=11211, avg=10643.69, stdev=803.40
     lat (usec): min=10075, max=11212, avg=10643.99, stdev=803.39
    clat percentiles (usec):
     |  1.00th=[10028],  5.00th=[10028], 10.00th=[10028], 20.00th=[10028],
     | 30.00th=[10028], 40.00th=[10028], 50.00th=[10028], 60.00th=[11207],
     | 70.00th=[11207], 80.00th=[11207], 90.00th=[11207], 95.00th=[11207],
     | 99.00th=[11207], 99.50th=[11207], 99.90th=[11207], 99.95th=[11207],
     | 99.99th=[11207]
  lat (msec)   : 20=100.00%
  cpu          : usr=0.00%, sys=9.52%, ctx=2, majf=0, minf=533
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=2,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
   READ: bw=60.5MiB/s (63.4MB/s), 60.5MiB/s-60.5MiB/s (63.4MB/s-63.4MB/s), io=64.0MiB (67.1MB), run=1058-1058msec

Run status group 1 (all jobs):
   READ: bw=240MiB/s (251MB/s), 240MiB/s-240MiB/s (251MB/s-251MB/s), io=64.0MiB (67.1MB), run=267-267msec

Run status group 2 (all jobs):
   READ: bw=2000MiB/s (2097MB/s), 2000MiB/s-2000MiB/s (2097MB/s-2097MB/s), io=64.0MiB (67.1MB), run=32-32msec

Run status group 3 (all jobs):
   READ: bw=2560MiB/s (2684MB/s), 2560MiB/s-2560MiB/s (2684MB/s-2684MB/s), io=64.0MiB (67.1MB), run=25-25msec

Run status group 4 (all jobs):
   READ: bw=2783MiB/s (2918MB/s), 2783MiB/s-2783MiB/s (2918MB/s-2918MB/s), io=64.0MiB (67.1MB), run=23-23msec

Run status group 5 (all jobs):
   READ: bw=2909MiB/s (3050MB/s), 2909MiB/s-2909MiB/s (3050MB/s-3050MB/s), io=64.0MiB (67.1MB), run=22-22msec

Run status group 6 (all jobs):
   READ: bw=3048MiB/s (3196MB/s), 3048MiB/s-3048MiB/s (3196MB/s-3196MB/s), io=64.0MiB (67.1MB), run=21-21msec

Run status group 7 (all jobs):
   READ: bw=2909MiB/s (3050MB/s), 2909MiB/s-2909MiB/s (3050MB/s-3050MB/s), io=64.0MiB (67.1MB), run=22-22msec

Disk stats (read/write):
  nvme1n1: ios=71570/134, sectors=179344/4416, merge=0/3, ticks=948/104, in_queue=1053, util=62.66%