sudo fio --name=raid5-fulltest --filename=/mnt/data1/raid5-fulltest.dat --size=1T --rw=write --bs=1M --ioengine=libaio --iodepth=16 --direct=1 --verify=crc32c --do_verify=1 --verify_fatal=1
--group_reporting
raid5-fulltest: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
raid5-fulltest: Laying out IO file (1 file / 1048576MiB)
Jobs: 1 (f=1): V(1)r=462MiB/s[eta 00m:00s]
raid5-fulltest: (groupid=0, jobs=1): err= 0: pid=112216: Sat Aug 29 11:43:41 2026
read: IOPS=422, BW=423MiB/s (443MB/s)(1024GiB/2480016msec)

slat (usec): min=21, max=377, avg=117.01, stdev=48.52
clat (usec): min=990, max=1582.5k, avg=37519.93, stdev=17452.37
 lat (usec): min=1109, max=1582.6k, avg=37636.95, stdev=17449.37
clat percentiles (usec):
 |  1.00th=[  1647],  5.00th=[  5538], 10.00th=[ 10159], 20.00th=[ 20317],
 | 30.00th=[ 32637], 40.00th=[ 38011], 50.00th=[ 41157], 60.00th=[ 44303],
 | 70.00th=[ 47449], 80.00th=[ 50070], 90.00th=[ 54789], 95.00th=[ 60031],
 | 99.00th=[ 72877], 99.50th=[ 77071], 99.90th=[ 90702], 99.95th=[103285],
 | 99.99th=[130548]

write: IOPS=393, BW=394MiB/s (413MB/s)(1024GiB/2662917msec); 0 zone resets

slat (usec): min=1112, max=133084, avg=1441.15, stdev=897.17
clat (msec): min=4, max=523, avg=39.19, stdev=20.49
 lat (msec): min=5, max=525, avg=40.63, stdev=20.49
clat percentiles (msec):
 |  1.00th=[   22],  5.00th=[   22], 10.00th=[   22], 20.00th=[   29],
 | 30.00th=[   33], 40.00th=[   34], 50.00th=[   34], 60.00th=[   35],
 | 70.00th=[   36], 80.00th=[   37], 90.00th=[   78], 95.00th=[   85],
 | 99.00th=[  110], 99.50th=[  124], 99.90th=[  157], 99.95th=[  178],
 | 99.99th=[  347]

bw ( KiB/s): min=67584, max=488400, per=100.00%, avg=403623.43, stdev=37374.03, samples=5323
iops : min= 66, max= 476, avg=393.95, stdev=36.48, samples=5323
lat (usec) : 1000=0.01%
lat (msec) : 2=0.72%, 4=0.76%, 10=3.45%, 20=4.88%, 50=72.48%
lat (msec) : 100=16.89%, 250=0.80%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2000=0.01%
cpu : usr=7.65%, sys=28.81%, ctx=1623599, majf=0, minf=28714
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%

 submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
 complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
 issued rwts: total=1048576,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
 latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
READ: bw=423MiB/s (443MB/s), 423MiB/s-423MiB/s (443MB/s-443MB/s), io=1024GiB (1100GB), run=2480016-2480016msec
WRITE: bw=394MiB/s (413MB/s), 394MiB/s-394MiB/s (413MB/s-413MB/s), io=1024GiB (1100GB), run=2662917-2662917msec

Disk stats (read/write):

dm-1: ios=1049368/1073697, sectors=2147434904/2152575728, merge=0/0, ticks=39320665/86615507, in_queue=125936172, util=100.00%, aggrios=2097970/1072835, aggsectors=2147490192/2152577800, aggrmerge=0/0, aggrticks=48587341/86399674, aggrin_queue=134987015, aggrutil=100.00%
md0: ios=2097970/1072835, sectors=2147490192/2152577800, merge=0/0, ticks=48587341/86399674, in_queue=134987015, util=100.00%, aggrios=680771/1068847, aggsectors=716205552/1076603685, aggrmerge=65488/133508975, aggrticks=15524340/23811662, aggrin_queue=39922929, aggrutil=98.21%

sdb: ios=660254/1068850, sectors=716205904/1076602589, merge=86134/133508836, ticks=30013862/28555098, in_queue=59408725, util=98.21%
sdc: ios=696999/1068809, sectors=716204568/1076604925, merge=49095/133509169, ticks=3364856/15028720, in_queue=18697322, util=77.29%
sda: ios=685062/1068883, sectors=716206186/1076603541, merge=61236/133508922, ticks=13194303/27851170, in_queue=41662740, util=95.26%
yangbo@appserver:~$

yangbo@appserver:~$ sudo fio --name=raid5-fulltest --filename=/mnt/data1/raid5-fulltest.dat --size=1T --rw=write --bs=1M --ioengine=libaio --iodepth=16 --direct=1 --verify=crc32c --do_verify=1 --verify_fatal=1
--group_reporting
raid5-fulltest: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=16
fio-3.36
Starting 1 process
raid5-fulltest: Laying out IO file (1 file / 1048576MiB)
Jobs: 1 (f=1): V(1)r=462MiB/s[eta 00m:00s]
raid5-fulltest: (groupid=0, jobs=1): err= 0: pid=112216: Sat Aug 29 11:43:41 2026
read: IOPS=422, BW=423MiB/s (443MB/s)(1024GiB/2480016msec)
slat (usec): min=21, max=377, avg=117.01, stdev=48.52
clat (usec): min=990, max=1582.5k, avg=37519.93, stdev=17452.37
lat (usec): min=1109, max=1582.6k, avg=37636.95, stdev=17449.37
clat percentiles (usec):
| 1.00th=[ 1647], 5.00th=[ 5538], 10.00th=[ 10159], 20.00th=[ 20317],
| 30.00th=[ 32637], 40.00th=[ 38011], 50.00th=[ 41157], 60.00th=[ 44303],
| 70.00th=[ 47449], 80.00th=[ 50070], 90.00th=[ 54789], 95.00th=[ 60031],
| 99.00th=[ 72877], 99.50th=[ 77071], 99.90th=[ 90702], 99.95th=[103285],
| 99.99th=[130548]
write: IOPS=393, BW=394MiB/s (413MB/s)(1024GiB/2662917msec); 0 zone resets
slat (usec): min=1112, max=133084, avg=1441.15, stdev=897.17
clat (msec): min=4, max=523, avg=39.19, stdev=20.49
lat (msec): min=5, max=525, avg=40.63, stdev=20.49
clat percentiles (msec):
| 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 29],
| 30.00th=[ 33], 40.00th=[ 34], 50.00th=[ 34], 60.00th=[ 35],
| 70.00th=[ 36], 80.00th=[ 37], 90.00th=[ 78], 95.00th=[ 85],
| 99.00th=[ 110], 99.50th=[ 124], 99.90th=[ 157], 99.95th=[ 178],
| 99.99th=[ 347]
bw ( KiB/s): min=67584, max=488400, per=100.00%, avg=403623.43, stdev=37374.03, samples=5323
iops : min= 66, max= 476, avg=393.95, stdev=36.48, samples=5323
lat (usec) : 1000=0.01%
lat (msec) : 2=0.72%, 4=0.76%, 10=3.45%, 20=4.88%, 50=72.48%
lat (msec) : 100=16.89%, 250=0.80%, 500=0.01%, 750=0.01%, 1000=0.01%
lat (msec) : 2000=0.01%
cpu : usr=7.65%, sys=28.81%, ctx=1623599, majf=0, minf=28714
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=100.0%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.1%, 32=0.0%, 64=0.0%, >=64=0.0%
issued rwts: total=1048576,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
READ: bw=423MiB/s (443MB/s), 423MiB/s-423MiB/s (443MB/s-443MB/s), io=1024GiB (1100GB), run=2480016-2480016msec
WRITE: bw=394MiB/s (413MB/s), 394MiB/s-394MiB/s (413MB/s-413MB/s), io=1024GiB (1100GB), run=2662917-2662917msec

Disk stats (read/write):
dm-1: ios=1049368/1073697, sectors=2147434904/2152575728, merge=0/0, ticks=39320665/86615507, in_queue=125936172, util=100.00%, aggrios=2097970/1072835, aggsectors=2147490192/2152577800, aggrmerge=0/0, aggrticks=48587341/86399674, aggrin_queue=134987015, aggrutil=100.00%
md0: ios=2097970/1072835, sectors=2147490192/2152577800, merge=0/0, ticks=48587341/86399674, in_queue=134987015, util=100.00%, aggrios=680771/1068847, aggsectors=716205552/1076603685, aggrmerge=65488/133508975, aggrticks=15524340/23811662, aggrin_queue=39922929, aggrutil=98.21%
sdb: ios=660254/1068850, sectors=716205904/1076602589, merge=86134/133508836, ticks=30013862/28555098, in_queue=59408725, util=98.21%
sdc: ios=696999/1068809, sectors=716204568/1076604925, merge=49095/133509169, ticks=3364856/15028720, in_queue=18697322, util=77.29%
sda: ios=685062/1068883, sectors=716206186/1076603541, merge=61236/133508922, ticks=13194303/27851170, in_queue=41662740, util=95.26%
yangbo@appserver:~$

sda sectors + sdb sectors + sdc sectors != md0

标签: none

添加新评论