RAID存储

RAID概念

RAID(Redundant Array of Independent Disks,独立磁盘冗余阵列)是一种将多块物理硬盘组合成一个逻辑单元的存储技术,核心目的是提升读写性能增加数据冗余(安全性) 或两者兼顾。

操作系统识别到的设备是raid卡提供的设备

RAID 主要通过三种核心技术实现:

  1. 条带化(Striping):数据被分割成固定大小的 “块”(Block),并行写入不同磁盘。大幅提升 I/O 性能。
  2. 镜像(Mirroring):数据完全复制到多块硬盘。提供 100% 冗余,安全性极高。
  3. 奇偶校验(Parity):通过算法计算数据的校验码并分散存储。单块硬盘损坏时,可通过校验码重建数据。

RAID实践

管理RAID0

1.创建RAID 0
#安装mdadm工具(centos系统)
[root@centos ~ 17:51:41]# yum install -y mdadm

#创建RAID 0阵列:设备名/dev/md0,成员盘两块(sdb sdc)
[root@centos ~ 18:26:15]# mdadm --create /dev/md0 --level 0 --raid-devices 2 /dev/sd{b,c}
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md0 started.

注释:--level指定RAID级别,--raid-devices指定成员盘数量,/dev/sd{b,c}sdbsdc的简写。

2.查看RAID 0状态
[root@centos ~ 18:26:24]# cat /proc/mdstat
Personalities : [raid0] 
md0 : active raid0 sdc[1] sdb[0]
      41908224 blocks super 1.2 512k chunks
      
unused devices: <none>
[root@centos ~ 18:26:39]# mdadm --detail /dev/md0
/dev/md0:
           Version : 1.2
     Creation Time : Thu Apr  9 18:26:24 2026
        Raid Level : raid0
        Array Size : 41908224 (39.97 GiB 42.91 GB)
      Raid Devices : 2
     Total Devices : 2
       Persistence : Superblock is persistent

       Update Time : Thu Apr  9 18:26:24 2026
             State : clean 
    Active Devices : 2
   Working Devices : 2
    Failed Devices : 0
     Spare Devices : 0

        Chunk Size : 512K

Consistency Policy : none

              Name : centos.cyh.cloud:0  (local to host centos.cyh.cloud)
              UUID : afbc9e64:3d8ef2b9:63c2045a:a15cbd1a
            Events : 0

    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc

注释:核心关注Raid Level(级别)、State(状态,clean为正常)、Chunk Size(条带块大小)、成员盘状态。

# 查看RAID设备与物理盘的映射关系
[root@centos ~ 18:27:19]# lsblk /dev/md0
NAME MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
md0    9:0    0  40G  0 raid0 
[root@centos ~ 18:28:09]# lsblk /dev/sdb /dev/sdc
NAME  MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
sdb     8:16   0  20G  0 disk  
└─md0   9:0    0  40G  0 raid0 
sdc     8:32   0  20G  0 disk  
└─md0   9:0    0  40G  0 raid0 
3 格式化与挂载 RAID 0
# 格式化RAID设备为XFS文件系统
[root@centos ~ 18:28:16]# mkfs.xfs /dev/md0
meta-data=/dev/md0               isize=512    agcount=16, agsize=654720 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0, sparse=0
data     =                       bsize=4096   blocks=10475520, imaxpct=25
         =                       sunit=128    swidth=256 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal log           bsize=4096   blocks=5120, version=2
         =                       sectsz=512   sunit=8 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0

#创建挂载点
[root@centos ~ 18:28:40]# mkdir -p /raid/raid0
#挂载RAID设备到挂载点
[root@centos ~ 18:29:00]# mount /dev/md0 /raid/raid0
#验证挂载结果 
[root@centos ~ 18:29:18]# df -h /raid/raid0
Filesystem      Size  Used Avail Use% Mounted on
/dev/md0         40G   33M   40G   1% /raid/raid0

#测试数据写入
[root@centos ~ 18:30:06]# cp /etc/ho* /raid/raid0
[root@centos ~ 18:32:41]# ls /raid/raid0/
host.conf  hosts        hosts.deny
hostname   hosts.allow
4 删除 RAID 0
# 卸载挂载点
[root@centos ~ 18:32:49]# umount /dev/md0

# 停止RAID阵列(销毁阵列)
[root@centos ~ 18:32:59]# mdadm --stop /dev/md0
mdadm: stopped /dev/md0

# 清除物理盘上的RAID超级块(恢复为普通磁盘)
[root@centos ~ 18:33:11]# mdadm --zero-superblock /dev/sd{b,c}

管理 RAID 1

1 创建 RAID 1
# 创建RAID 1阵列:设备名/dev/md1,级别1,成员盘2块(sdb、sdc)
[root@centos ~ 18:43:43]# mdadm --create /dev/md1 --level 1 --raid-devices 2 /dev/sd{b,c}
mdadm: Note: this array has metadata at the start and
    may not be suitable as a boot device.  If you plan to
    store '/boot' on this device please ensure that
    your boot-loader understands md/v1.x metadata, or use
    --metadata=0.90
Continue creating array? yes
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md1 started.

注释:RAID 1元数据默认存储在磁盘开头,若用于/boot分区需指定--metadata=0.90兼容老旧引导程序。

2 查看 RAID 1 状态
[root@centos ~ 19:03:51]# mdadm --detail /dev/md1
/dev/md1:
           Version : 1.2
     Creation Time : Thu Apr  9 19:03:51 2026
        Raid Level : raid1
        Array Size : 20954112 (19.98 GiB 21.46 GB)
     Used Dev Size : 20954112 (19.98 GiB 21.46 GB)
      Raid Devices : 2
     Total Devices : 2
       Persistence : Superblock is persistent

       Update Time : Thu Apr  9 19:04:17 2026
             State : clean, resyncing 
    Active Devices : 2
   Working Devices : 2
    Failed Devices : 0
     Spare Devices : 0

Consistency Policy : resync

     Resync Status : 27% complete

              Name : centos.cyh.cloud:1  (local to host centos.cyh.cloud)
              UUID : 78d11075:faf09189:d75522da:786a7013
            Events : 4

    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc

注释:resyncing表示镜像数据正在同步,需等待同步完成(100%)后再进行格式化操作。

# 查看RAID与物理盘映射
[root@centos ~ 19:04:39]# lsblk /dev/md1
NAME MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
md1    9:1    0  20G  0 raid1 


[root@centos ~ 19:04:59]# lsblk /dev/sdb /dev/sdc
NAME  MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
sdb     8:16   0  20G  0 disk  
└─md1   9:1    0  20G  0 raid1 
sdc     8:32   0  20G  0 disk  
└─md1   9:1    0  20G  0 raid1 

3 格式化与挂载 RAID 1
# 等待同步完成后,格式化RAID设备
[root@centos ~ 19:06:04]# mkfs.xfs /dev/md1 -f
meta-data=/dev/md1               isize=512    agcount=4, agsize=1309632 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0, sparse=0
data     =                       bsize=4096   blocks=5238528, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal log           bsize=4096   blocks=2560, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
[root@centos ~ 19:07:02]# mkdir /raid/raid1

# 挂载设备
[root@centos ~ 19:07:24]# mount /dev/md1 /raid/raid1

# 验证挂载
[root@centos ~ 19:07:37]# df -h /raid/raid1
Filesystem      Size  Used Avail Use% Mounted on
/dev/md1         20G   33M   20G   1% /raid/raid1



# 测试数据写入
[root@centos ~ 19:07:47]# cp /etc/ho* /raid/raid1
[root@centos ~ 19:08:07]# ls /raid/raid1/
host.conf  hosts        hosts.deny
hostname   hosts.allow
4 增加热备盘
# 为RAID 1添加热备盘sdd
[root@centos ~ 19:08:16]# mdadm --add /dev/md1 /dev/sdd
mdadm: added /dev/sdd

# 查看热备盘状态(spare为备用)
[root@centos ~ 19:08:43]# mdadm --detail /dev/md1 |tail -5
    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc

       2       8       48        -      spare   /dev/sdd

5 模拟磁盘故障
# 手动标记sdc为故障盘
[root@centos ~ 19:09:08]# mdadm --fail /dev/md1 /dev/sdc
mdadm: set /dev/sdc faulty in /dev/md1

# 查看故障后状态(sdd自动顶替并同步)
[root@centos ~ 19:09:28]# mdadm --detail /dev/md1 |tail -5
    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       2       8       48        1      spare rebuilding   /dev/sdd

       1       8       32        -      faulty   /dev/sdc

# 验证数据可正常访问
[root@centos ~ 19:10:36]# ls /raid/raid1/
host.conf  hosts        hosts.deny
hostname   hosts.allow
[root@centos ~ 19:10:46]# cat /raid/raid1/hostname
centos.cyh.cloud
6 删除故障磁盘
[root@centos ~ 19:11:03]# mdadm --remove /dev/md1 /dev/sdc
mdadm: hot removed /dev/sdc from /dev/md1
[root@centos ~ 19:11:30]# mdadm --detail /dev/md1 |tail -5
            Events : 44

    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       2       8       48        1      active sync   /dev/sdd

7 再次模拟故障
[root@centos ~ 19:11:48]# mdadm --fail /dev/md1 /dev/sdd
mdadm: set /dev/sdd faulty in /dev/md1
[root@centos ~ 19:12:07]# mdadm -D /dev/md1|tail -5    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       -       0        0        1      removed

       2       8       48        -      faulty   /dev/sdd
[root@centos ~ 19:12:38]# ls /raid/raid1
host.conf  hosts        hosts.deny
hostname   hosts.allow
[root@centos ~ 19:12:52]# umount /raid/raid1
[root@centos ~ 19:13:03]# mount /dev/md1 /raid/raid1
[root@centos ~ 19:13:21]# ls /raid/raid1
host.conf  hosts        hosts.deny
hostname   hosts.allow

总结:raid1阵列中任一成员故障,不影响数据的完整性。

8 删除 RAID 1
# 卸载挂载点
[root@centos ~ 19:13:29]# umount /dev/md1
# 停止RAID阵列
[root@centos ~ 19:13:48]# mdadm --stop /dev/md1
mdadm: stopped /dev/md1
# 清除物理盘超级块
[root@centos ~ 19:14:01]# mdadm --zero-superblock /dev/sd{b..d}

使用dd工具填充更彻底。

[root@centos ~ 19:35:01]# dd if=/dev/zero of=/dev/sdb bs=1M count=1024
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 16.535 s, 64.9 MB/s

作用:使用0填充/dev/sdb硬盘。

  • if:Input File,/dev/zero 全为0
  • of:Output File
  • bs:Block Size,每次添加多大数据流
  • count:一共填充多少个Block
9 补充说明

RAID 1核心价值是数据冗余,而非扩容:即使新增磁盘,阵列总容量仍等于单盘容量(镜像机制),无法通过加盘提升可用空间。

管理 RAID 5

1 创建 RAID 5
# 创建RAID 5阵列:设备名/dev/md5,级别5,成员盘4块(sdb、sdc、sdd、sde)
[root@centos ~ 19:35:25]# mdadm --create /dev/md5 --level 5 --raid-devices 4 /dev/sd{b..e}
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md5 started.

注释:RAID 5最少需3块盘,此处用4块盘(1块用于分布式校验)。

2 查看 RAID 5 状态
[root@centos ~ 19:36:11]# mdadm --detail /dev/md5
/dev/md5:
           Version : 1.2
     Creation Time : Thu Apr  9 19:36:11 2026
        Raid Level : raid5
        Array Size : 62862336 (59.95 GiB 64.37 GB)
     Used Dev Size : 20954112 (19.98 GiB 21.46 GB)
      Raid Devices : 4
     Total Devices : 4
       Persistence : Superblock is persistent

       Update Time : Thu Apr  9 19:36:22 2026
             State : clean, degraded, recovering 
    Active Devices : 3
   Working Devices : 4
    Failed Devices : 0
     Spare Devices : 1

            Layout : left-symmetric
        Chunk Size : 512K

Consistency Policy : resync

    Rebuild Status : 11% complete

              Name : centos.cyh.cloud:5  (local to host centos.cyh.cloud)
              UUID : 0c8cbf33:a9c86a25:f8208e90:eec3bd16
            Events : 2

    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      spare rebuilding   /dev/sde

注释:recovering表示阵列正在构建/同步,需等待同步完成后再格式化。

# 查看RAID与物理盘映射
[root@centos ~ 19:36:30]# lsblk /dev/md5
NAME MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
md5    9:5    0  60G  0 raid5 
  
[root@centos ~ 19:36:58]# lsblk /dev/sd{b..e}
NAME  MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
sdb     8:16   0  20G  0 disk  
└─md5   9:5    0  60G  0 raid5 
sdc     8:32   0  20G  0 disk  
└─md5   9:5    0  60G  0 raid5 
sdd     8:48   0  20G  0 disk  
└─md5   9:5    0  60G  0 raid5 
sde     8:64   0  20G  0 disk  
└─md5   9:5    0  60G  0 raid5 
3 格式化与挂载 RAID 5
# 等待阵列同步完成后,格式化设备
[root@centos ~ 19:37:22]# mkfs.xfs /dev/md5
meta-data=/dev/md5               isize=512    agcount=16, agsize=982144 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0, sparse=0
data     =                       bsize=4096   blocks=15714304, imaxpct=25
         =                       sunit=128    swidth=384 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal log           bsize=4096   blocks=7680, version=2
         =                       sectsz=512   sunit=8 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
# 创建挂载点
[root@centos ~ 19:37:42]# mkdir /raid/raid5
# 挂载设备
[root@centos ~ 19:37:53]# mount /dev/md5 /raid/raid5
# 验证挂载
[root@centos ~ 19:38:34]# df -h /raid/raid5/
Filesystem      Size  Used Avail Use% Mounted on
/dev/md5         60G   33M   60G   1% /raid/raid5
# 测试数据写入
[root@centos ~ 19:38:49]# cp /etc/ho* /raid/raid5
[root@centos ~ 19:39:10]# ls /raid/raid5/
host.conf  hosts        hosts.deny
hostname   hosts.allow
4 增加热备盘
# 为RAID 5添加热备盘sdf
[root@centos ~ 19:40:21]# mdadm --add /dev/md5 /dev/sdf
mdadm: added /dev/sdf

# 查看热备盘状态
[root@centos ~ 19:41:20]# mdadm -D /dev/md5 |tail -7
    Number   Major   Minor   RaidDevice State
       0       8       16        0      active sync   /dev/sdb
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde

       5       8       80        -      spare   /dev/sdf

5 模拟磁盘故障
# 标记sdb为故障盘
[root@centos ~ 19:41:24]# mdadm --fail /dev/md5 /dev/sdb
mdadm: set /dev/sdb faulty in /dev/md5

# 查看故障后状态(sdf自动顶替并同步)
[root@centos ~ 19:41:43]# mdadm --detail /dev/md5 |tail -7
    Number   Major   Minor   RaidDevice State
       5       8       80        0      spare rebuilding   /dev/sdf
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde

       0       8       16        -      faulty   /dev/sdb
# 验证数据可正常访问
[root@centos ~ 19:42:06]# ls /raid/raid5/
host.conf  hosts        hosts.deny
hostname   hosts.allow
[root@centos ~ 19:43:20]# cat /raid/raid5/hostname
centos.cyh.cloud
6 删除故障磁盘
# 移除故障盘sdb
[root@centos ~ 20:30:31]# mdadm --remove /dev/md5 /dev/sdb
mdadm: hot removed /dev/sdb from /dev/md5

# 验证移除结果
[root@centos ~ 21:45:52]# mdadm --detail /dev/md5 |tail -5
       5       8       80        0      active sync   /dev/sdf
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde
       6       8       96        4      active sync   /dev/sdg
7 扩容 RAID 5

注释:RAID 5仅支持扩容(增加成员盘),不支持减容;扩容仅在阵列“clean”正常状态下可执行,降级/重构时禁止。

# 新增2块盘(sdb、sdg)到RAID 5
[root@centos ~ 21:46:16]# mdadm --add /dev/md5 /dev/sdb /dev/sdg
mdadm: added /dev/sdb
mdadm: Cannot open /dev/sdg: Device or resource busy

# 查看新增盘状态(spare为备用)
[root@centos ~ 21:47:00]# mdadm --detail /dev/md5 |tail -8
    Number   Major   Minor   RaidDevice State
       5       8       80        0      active sync   /dev/sdf
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde
       6       8       96        4      active sync   /dev/sdg

       7       8       16        -      spare   /dev/sdb
[root@centos ~ 21:48:04]# mdadm --grow /dev/md5 --raid-devices 5
mdadm: /dev/md5: no change requested

# 扩展阵列成员数为5(--grow为扩容参数)
[root@centos ~ 21:48:34]# mdadm --grow /dev/md5 --raid-devices 5
mdadm: /dev/md5: no change requested

# 等待阵列重构完成(查看进度)
[root@centos ~ 21:48:54]# mdadm --detail /dev/md5
/dev/md5:
           Version : 1.2
     Creation Time : Thu Apr  9 19:36:11 2026
        Raid Level : raid5
        Array Size : 83816448 (79.93 GiB 85.83 GB)
     Used Dev Size : 20954112 (19.98 GiB 21.46 GB)
      Raid Devices : 5
     Total Devices : 6
       Persistence : Superblock is persistent

       Update Time : Thu Apr  9 21:47:00 2026
             State : clean 
    Active Devices : 5
   Working Devices : 6
    Failed Devices : 0
     Spare Devices : 1

            Layout : left-symmetric
        Chunk Size : 512K

Consistency Policy : resync

              Name : centos.cyh.cloud:5  (local to host centos.cyh.cloud)
              UUID : 0c8cbf33:a9c86a25:f8208e90:eec3bd16
            Events : 99

    Number   Major   Minor   RaidDevice State
       5       8       80        0      active sync   /dev/sdf
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde
       6       8       96        4      active sync   /dev/sdg

       7       8       16        -      spare   /dev/sdb

# 验证RAID容量(从60G扩容至80G)
[root@centos ~ 21:49:32]# lsblk /dev/md5
NAME MAJ:MIN RM SIZE RO TYPE  MOUNTPOINT
md5    9:5    0  80G  0 raid5 /raid/raid5

# 扩展文件系统(XFS文件系统用xfs_growfs)
[root@centos ~ 21:51:37]# xfs_growfs /raid/raid5
meta-data=/dev/md5               isize=512    agcount=16, agsize=982144 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0 spinodes=0
data     =                       bsize=4096   blocks=15714304, imaxpct=25
         =                       sunit=128    swidth=384 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal               bsize=4096   blocks=7680, version=2
         =                       sectsz=512   sunit=8 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
data blocks changed from 15714304 to 20954112
[root@centos ~ 21:52:04]# df -h /raid/raid5/
Filesystem      Size  Used Avail Use% Mounted on
/dev/md5         80G   34M   80G   1% /raid/raid5

8 再次模拟磁盘故障
[root@centos ~ 21:52:19]# mdadm --remove /dev/md5 /dev/sdb
mdadm: hot removed /dev/sdb from /dev/md5
[root@centos ~ 21:52:43]# mdadm --fail /dev/md5 /dev/sdg
mdadm: set /dev/sdg faulty in /dev/md5
[root@centos ~ 21:53:05]# mdadm -D /dev/md5 |tail
            Events : 104

    Number   Major   Minor   RaidDevice State
       5       8       80        0      active sync   /dev/sdf
       1       8       32        1      active sync   /dev/sdc
       2       8       48        2      active sync   /dev/sdd
       4       8       64        3      active sync   /dev/sde
       -       0        0        4      removed

       6       8       96        -      faulty   /dev/sdg
[root@centos ~ 21:53:38]# ls /raid/raid5
host.conf  hosts        hosts.deny
hostname   hosts.allow
[root@centos ~ 21:54:10]# echo hello raid5 > /raid/raid5/test.txt
[root@centos ~ 21:54:35]# umount /raid/raid5
[root@centos ~ 21:54:56]# mount /dev/md5 /raid/raid5
[root@centos ~ 21:55:09]# ls /raid/raid5
host.conf  hosts        hosts.deny
hostname   hosts.allow  test.txt

9 删除 RAID 5
[root@centos ~ 21:55:18]# umount /dev/md5
[root@centos ~ 21:55:32]# mdadm --stop /dev/md5
mdadm: stopped /dev/md5
[root@centos ~ 21:55:51]# mdadm --zero-superblock /dev/sd{b..g}

也可以使用dd彻底擦除:

for device in /dev/sd{b..g}
do
  dd if=/dev/zero of=$device bs=1M count=1024
done

1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 6.66946 s, 161 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.39322 s, 449 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.16136 s, 497 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.09655 s, 512 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.13477 s, 503 MB/s
1024+0 records in
1024+0 records out
1073741824 bytes (1.1 GB) copied, 2.12995 s, 504 MB/s
10 重构 RAID 5

注释:若停止阵列后未清除超级块,可通过以下命令重构阵列,数据不丢失:

[root@centos7 ~]# mdadm --assemble /dev/md5 /dev/sd{b..g}

LVM 存储

逻辑卷基本管理

传统硬盘分区管理的缺点

传统硬盘分区方案在灵活性和可靠性上存在明显不足,主要体现在:

  1. 分区空间需占用物理连续的磁盘区域,扩容操作难度大(尤其是扩容分区后方无空闲空间时);
  2. 基于分区创建的文件系统无法跨多个硬盘,受单块硬盘容量限制;
  3. 硬盘物理损坏时,分区内的所有数据会直接丢失,无冗余保护机制

逻辑卷管理的优势

LVM 作为一种灵活的存储管理方案,弥补了传统分区的不足,核心优势包括:

  1. 灵活的空间调整:支持逻辑卷空间的在线扩展和缩减,无需重新规划磁盘布局;
  2. 跨盘存储能力:逻辑卷可整合多块硬盘的空间,轻松创建超大容量文件系统;
  3. 数据冗余保护:支持创建镜像卷(RAID 逻辑卷),单块硬盘损坏时数据不丢失;
  4. 快照功能:可创建逻辑卷快照,保留某一时刻的数据集,类似虚拟机快照,便于数据恢复。

LVM 核心概念

LVM 将多个磁盘/分区整合为统一的存储池,再按需划分逻辑卷使用,核心概念如下:

  • 物理卷(PV, Physical Volume):LVM 的基础存储单元,由磁盘、磁盘分区或 RAID 等块设备创建,包含 LVM 专属的管理参数;
  • 卷组(VG, Volume Group):由一个或多个物理卷组成的逻辑存储池,可理解为“虚拟硬盘”;
  • 逻辑卷(LV, Logical Volume):从卷组中划分出的逻辑空间,可理解为“虚拟分区”,可在其上创建文件系统并挂载使用。

简单总结:卷组整合多个物理卷形成存储池,逻辑卷从卷组中划分并提供给用户使用。

1.创建物理卷(PV)

物理卷是 LVM 的基础,需先将块设备初始化为 PV 才能纳入 LVM 管理:

# 1. 创建单个物理卷
[root@centos ~ 22:37:12]# pvcreate /dev/sdb
  Physical volume "/dev/sdb" successfully created.

# 2. 批量创建多个物理卷(sdc、sdd)
[root@centos ~ 22:38:20]# pvcreate /dev/sd{c,d}
  Physical volume "/dev/sdc" successfully created.
  Physical volume "/dev/sdd" successfully created.
  
  # 3. 查看所有 PV 列表(简洁版)
  [root@centos ~ 22:38:33]# pvs
  PV         VG     Fmt  Attr PSize    PFree 
  /dev/sda2  centos lvm2 a--  <199.00g  4.00m
  /dev/sdb          lvm2 ---    20.00g 20.00g
  /dev/sdc          lvm2 ---    20.00g 20.00g
  /dev/sdd          lvm2 ---    20.00g 20.00g
# 4. 查看单个 PV 的详细信息(以 /dev/sdb 为例)
[root@centos ~ 22:38:37]# pvdisplay /dev/sdb
  "/dev/sdb" is a new physical volume of "20.00 GiB"
  --- NEW Physical volume ---
  PV Name               /dev/sdb
  VG Name               
  PV Size               20.00 GiB
  Allocatable           NO
  PE Size               0   
  Total PE              0
  Free PE               0
  Allocated PE          0
  PV UUID               fL4vlg-ZVTo-3Xgv-36XA-P1Fw-rbju-0X5PfQ

2.创建卷组(VG)

卷组整合多个物理卷形成统一存储池,可按需创建单 PV 或多 PV 的 VG:

# 1. 创建包含单个 PV 的卷组(卷组名:webapp,关联 PV:/dev/sdb)
[root@centos ~ 22:38:49]# vgcreate webapp /dev/sdb
  Volume group "webapp" successfully created

# 2. 创建包含多个 PV 的卷组(卷组名:dbapp,关联 PV:/dev/sdc、/dev/sdd)
[root@centos ~ 22:39:13]# vgcreate dbapp /dev/sd{c,d}
  Volume group "dbapp" successfully created

# 3. 查看 PV 归属(验证 PV 已加入对应 VG)
[root@centos ~ 22:39:47]# pvs
  PV         VG     Fmt  Attr PSize    PFree  
  /dev/sda2  centos lvm2 a--  <199.00g   4.00m
  /dev/sdb   webapp lvm2 a--   <20.00g <20.00g
  /dev/sdc   dbapp  lvm2 a--   <20.00g <20.00g
  /dev/sdd   dbapp  lvm2 a--   <20.00g <20.00g

# 4. 查看所有 VG 列表(简洁版)
[root@centos ~ 22:39:50]# vgs
  VG     #PV #LV #SN Attr   VSize    VFree  
  centos   1   3   0 wz--n- <199.00g   4.00m
  dbapp    2   0   0 wz--n-   39.99g  39.99g
  webapp   1   0   0 wz--n-  <20.00g <20.00g

# 5. 查看单个 VG 的详细信息(以 dbapp 为例)
[root@centos ~ 22:39:57]# vgdisplay dbapp
  --- Volume group ---
  VG Name               dbapp
  System ID             
  Format                lvm2
  Metadata Areas        2
  Metadata Sequence No  1
  VG Access             read/write
  VG Status             resizable
  MAX LV                0
  Cur LV                0
  Open LV               0
  Max PV                0
  Cur PV                2
  Act PV                2
  VG Size               39.99 GiB
  PE Size               4.00 MiB
  Total PE              10238
  Alloc PE / Size       0 / 0   
  Free  PE / Size       10238 / 39.99 GiB
  VG UUID               VcVtws-Mr0R-Wm28-wVhY-BPcc-0GEm-7HS4cm
   

3. 创建逻辑卷(LV)

逻辑卷从卷组中划分,可直接创建文件系统,支持跨 PV 分配空间:

# 1. 创建单 PV 逻辑卷(卷组:webapp,LV名:webapp01,大小:5G)

# 2. 创建跨 PV 逻辑卷(卷组:dbapp,LV名:data01,大小:25G,跨sdc、sdd)
[root@centos ~ 22:40:50]# lvcreate -n webapp01 -L 5G webapp
  Logical volume "webapp01" created.
[root@centos ~ 22:41:29]# lvcreate -n data01 -L 25G dbapp
  Logical volume "data01" created.

# 3. 查看所有 LV 列表(简洁版)
[root@centos ~ 22:41:53]# lvs
  LV       VG     Attr       LSize   Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  home     centos -wi-ao---- 146.99g                                                    
  root     centos -wi-ao----  50.00g                                                    
  swap     centos -wi-ao----   2.00g                                                    
  data01   dbapp  -wi-a-----  25.00g                                                    
  webapp01 webapp -wi-a-----   5.00g                             

查看逻辑卷详细信息

[root@centos ~ 22:41:56]# lvdisplay /dev/dbapp/data01
  --- Logical volume ---
  LV Path                /dev/dbapp/data01
  LV Name                data01
  VG Name                dbapp
  LV UUID                ylFPVC-XMwl-xKnD-N502-Vndg-LrbG-Lmdssx
  LV Write Access        read/write
  LV Creation host, time centos.cyh.cloud, 2026-04-09 22:41:53 +0800
  LV Status              available
  # open                 0
  LV Size                25.00 GiB
  Current LE             6400
  Segments               2
  Allocation             inherit
  Read ahead sectors     auto
  - currently set to     8192
  Block device           253:4
  
  # 验证 PV 空间使用(sdc 已用完,sdd 用了5G)
  [root@centos ~ 22:43:15]# pvs
  PV         VG     Fmt  Attr PSize    PFree  
  /dev/sda2  centos lvm2 a--  <199.00g   4.00m
  /dev/sdb   webapp lvm2 a--   <20.00g <15.00g
  /dev/sdc   dbapp  lvm2 a--   <20.00g      0 
  /dev/sdd   dbapp  lvm2 a--   <20.00g  14.99g


# 验证 LV 跨盘(data01 同时占用 sdc、sdd)
[root@centos ~ 22:43:23]# lsblk /dev/sd{b..d}
NAME              MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sdb                 8:16   0  20G  0 disk 
└─webapp-webapp01 253:3    0   5G  0 lvm  
sdc                 8:32   0  20G  0 disk 
└─dbapp-data01    253:4    0  25G  0 lvm  
sdd                 8:48   0  20G  0 disk 
└─dbapp-data01    253:4    0  25G  0 lvm  

4.在逻辑卷上创建文件系统

逻辑卷创建后需格式化文件系统并挂载,才能供业务使用:

# 1. 格式化 XFS 文件系统(CentOS7 推荐)
[root@centos ~ 22:44:02]# mkfs.xfs /dev/webapp/webapp01
meta-data=/dev/webapp/webapp01   isize=512    agcount=4, agsize=327680 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0, sparse=0
data     =                       bsize=4096   blocks=1310720, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal log           bsize=4096   blocks=2560, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0

# 2. 临时挂载逻辑卷(重启失效)
[root@centos ~ 22:44:27]# mount /dev/webapp/webapp01 /usr/share/nginx/html

# 3. 持久化挂载(修改 /etc/fstab,重启生效)
[root@centos ~ 22:45:06]# vim /etc/fstab
# /dev/webapp/webapp01  /usr/share/nginx/html  xfs  defaults  0 0

5.LVM 清理(删除 PV/VG/LV)

# 1. 卸载已挂载的逻辑卷[root@centos ~ 22:46:10]# umount /dev/webapp/webapp01

# 2. 删除逻辑卷(需确认,输入y)
[root@centos ~ 22:46:32]# lvremove /dev/webapp/webapp01 /dev/dbapp/data01
Do you really want to remove active logical volume webapp/webapp01? [y/n]: y
  Logical volume "webapp01" successfully removed
Do you really want to remove active logical volume dbapp/data01? [y/n]: y
  Logical volume "data01" successfully removed

# 3. 删除卷组
[root@centos ~ 22:47:18]# vgremove webapp dbapp
  Volume group "webapp" successfully removed
  Volume group "dbapp" successfully removed

# 4. 删除物理卷(清除 LVM 元数据)
[root@centos ~ 22:47:33]# pvremove /dev/sd{b..d}
  Labels on physical volume "/dev/sdb" successfully wiped.
  Labels on physical volume "/dev/sdc" successfully wiped.
  Labels on physical volume "/dev/sdd" successfully wiped.

卷组的扩展与缩减

卷组的容量可通过添加/移除 PV 灵活调整,满足业务存储需求变化。

1.环境准备

先创建基础卷组和逻辑卷,用于后续扩展/缩减测试:

# 1. 创建卷组 webapp(关联 PV /dev/sdb,自动初始化 PV)
[root@centos ~ 22:48:10]# vgcreate webapp /dev/sdb
  Physical volume "/dev/sdb" successfully created.
  Volume group "webapp" successfully created

# 2. 在 webapp 中创建 10G 逻辑卷 webapp01
[root@centos ~ 23:10:43]# lvcreate -n webapp01 -L 10G webapp
WARNING: xfs signature detected on /dev/webapp/webapp01 at offset 0. Wipe it? [y/n]: y
  Wiping xfs signature on /dev/webapp/webapp01.
  Logical volume "webapp01" created.

2.扩展卷组(VG)

当卷组空间不足时,可添加新 PV 扩展容量:

# 将 /dev/sdc、/dev/sdd 加入 webapp 卷组(自动初始化 PV)
[root@centos ~ 23:11:00]# vgextend webapp /dev/sd{c,d}
  Physical volume "/dev/sdc" successfully created.
  Physical volume "/dev/sdd" successfully created.
  Volume group "webapp" successfully extended

3.缩减卷组(VG)

如需移除卷组中的 PV(如更换更大硬盘),需确保 PV 未被使用,步骤如下:

# 1. 查看 PV 使用状态(/dev/sdb 已分配10G,sdc/sdd 空闲)
[root@centos ~ 23:11:45]# pvs
  PV         VG     Fmt  Attr PSize    PFree  
  /dev/sda2  centos lvm2 a--  <199.00g   4.00m
  /dev/sdb   webapp lvm2 a--   <20.00g <10.00g
  /dev/sdc   webapp lvm2 a--   <20.00g <20.00g
  /dev/sdd   webapp lvm2 a--   <20.00g <20.00g

# 2. 直接移除已使用的 PV 会报错
[root@centos ~ 23:11:52]# vgreduce webapp /dev/sdb
  Physical volume "/dev/sdb" still in use
# 3. 迁移 PV 数据(将 /dev/sdb 的数据移到 /dev/sdd)
[root@centos ~ 23:12:20]# pvmove /dev/sdb /dev/sdd
  /dev/sdb: Moved: 2.34%
  /dev/sdb: Moved: 100.00%

# 4. 再次查看 PV 状态(/dev/sdb 空闲,/dev/sdd 已使用)
[root@centos ~ 23:13:05]# pvs
  PV         VG     Fmt  Attr PSize    PFree  
  /dev/sda2  centos lvm2 a--  <199.00g   4.00m
  /dev/sdb   webapp lvm2 a--   <20.00g <20.00g
  /dev/sdc   webapp lvm2 a--   <20.00g <20.00g
  /dev/sdd   webapp lvm2 a--   <20.00g <10.00g
# 5. 移除空闲的 /dev/sdb 从 webapp 卷组
[root@centos ~ 23:13:08]# vgreduce webapp /dev/sdb
  Removed "/dev/sdb" from volume group "webapp"

# 6. 验证移除结果(/dev/sdb 已脱离 webapp)
[root@centos ~ 23:13:35]# pvs
  PV         VG     Fmt  Attr PSize    PFree  
  /dev/sda2  centos lvm2 a--  <199.00g   4.00m
  /dev/sdb          lvm2 ---    20.00g  20.00g
  /dev/sdc   webapp lvm2 a--   <20.00g <20.00g
  /dev/sdd   webapp lvm2 a--   <20.00g <10.00g

逻辑卷的扩展与缩减

逻辑卷的容量可直接调整,需结合卷组空闲空间操作。

1.扩展逻辑卷(LV)

卷组有空闲空间时,可直接扩展 LV 容量:

# 给 webapp01 增加 2G 空间(总容量变为 12G)
[root@centos ~ 23:13:40]# lvextend -L +2G /dev/webapp/webapp01
  Size of logical volume webapp/webapp01 changed from 10.00 GiB (2560 extents) to 12.00 GiB (3072 extents).
  Logical volume webapp/webapp01 successfully resized.

# 验证 LV 大小
[root@centos ~ 23:14:46]# lvs /dev/webapp/webapp01
  LV       VG     Attr       LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  webapp01 webapp -wi-a----- 12.00g 

2.缩减逻辑卷(LV)

逻辑卷空间充足时,可缩减容量(注意:缩减有数据丢失风险,需谨慎):

# 给 webapp01 减少 2G 空间(总容量变回 10G)
[root@centos ~ 23:15:02]# lvreduce -L -2G /dev/webapp/webapp01
  WARNING: Reducing active logical volume to 10.00 GiB.
  THIS MAY DESTROY YOUR DATA (filesystem etc.)
Do you really want to reduce webapp/webapp01? [y/n]: y
  Size of logical volume webapp/webapp01 changed from 12.00 GiB (3072 extents) to 10.00 GiB (2560 extents).
  Logical volume webapp/webapp01 successfully resized.

# 验证 LV 大小
[root@centos ~ 23:16:01]# lvs /dev/webapp/webapp01
  LV       VG     Attr       LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  webapp01 webapp -wi-a----- 10.00g         

文件系统的扩展与缩减

LV 容量调整后,需同步调整文件系统大小,否则无法使用新增空间(或缩减后空间异常)。

1 扩展 XFS 文件系统

XFS 是 CentOS7 默认文件系统,仅支持扩展,不支持缩减,步骤如下:

环境准备
# 1. 格式化 LV 为 XFS
[root@centos ~ 23:22:54]# mkfs.xfs /dev/webapp/webapp01
meta-data=/dev/webapp/webapp01   isize=512    agcount=4, agsize=655360 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0, sparse=0
data     =                       bsize=4096   blocks=2621440, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal log           bsize=4096   blocks=2560, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
[root@centos ~ 23:42:20]# mkdir /usr/share/nginx/html
mkdir: cannot create directory ‘/usr/share/nginx/html’: File exists

# 2. 创建挂载点并挂载
[root@centos ~ 23:42:36]# mount /dev/webapp/webapp01 /usr/share/nginx/html

# 3. 写入测试数据
[root@centos ~ 23:43:10]# cp /etc/host* /usr/share/nginx/html
[root@centos ~ 23:43:32]# ls /usr/share/nginx/html
host.conf  hosts        hosts.deny
hostname   hosts.allow

扩展操作
# 第一步:扩展 LV 到 15G
[root@centos ~ 23:43:50]# lvextend -L 15G /dev/webapp/webapp01
  Size of logical volume webapp/webapp01 changed from 10.00 GiB (2560 extents) to 15.00 GiB (3840 extents).
  Logical volume webapp/webapp01 successfully resized.
[root@centos ~ 23:44:40]# lvs /dev/webapp/webapp01
  LV       VG     Attr       LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  webapp01 webapp -wi-ao---- 15.00g     # -wi-ao----:已挂载、可读写、激活
                                             # 第二步:扩展 XFS 文件系统(指定挂载点)
[root@centos ~ 23:44:52]# xfs_growfs /usr/share/nginx/html
meta-data=/dev/mapper/webapp-webapp01 isize=512    agcount=4, agsize=655360 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0 spinodes=0
data     =                       bsize=4096   blocks=2621440, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal               bsize=4096   blocks=2560, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
data blocks changed from 2621440 to 3932160

# 验证文件系统大小(已扩展到15G,数据未丢失)
[root@centos ~ 23:45:23]# df -h /usr/share/nginx/html
Filesystem                   Size  Used Avail Use% Mounted on
/dev/mapper/webapp-webapp01   15G   33M   15G   1% /usr/share/nginx/html
[root@centos ~ 23:45:45]# ls /usr/share/nginx/html
host.conf  hosts        hosts.deny
hostname   hosts.allow

# 快捷方式:LV + 文件系统一键扩展(-r 参数自动调用 xfs_growfs)
[root@centos ~ 23:46:09]# lvextend -rL 20G /dev/webapp/webapp01
  Size of logical volume webapp/webapp01 changed from 15.00 GiB (3840 extents) to 20.00 GiB (5120 extents).
  Logical volume webapp/webapp01 successfully resized.
meta-data=/dev/mapper/webapp-webapp01 isize=512    agcount=6, agsize=655360 blks
         =                       sectsz=512   attr=2, projid32bit=1
         =                       crc=1        finobt=0 spinodes=0
data     =                       bsize=4096   blocks=3932160, imaxpct=25
         =                       sunit=0      swidth=0 blks
naming   =version 2              bsize=4096   ascii-ci=0 ftype=1
log      =internal               bsize=4096   blocks=2560, version=2
         =                       sectsz=512   sunit=0 blks, lazy-count=1
realtime =none                   extsz=4096   blocks=0, rtextents=0
data blocks changed from 3932160 to 5242880
[root@centos ~ 23:46:40]# lvs /dev/webapp/webapp01
  LV       VG     Attr       LSize  Pool Origin Data%  Meta%  Move Log Cpy%Sync Convert
  webapp01 webapp -wi-ao---- 20.00g                                                    
[root@centos ~ 23:46:55]# df -h /usr/share/nginx/html
Filesystem                   Size  Used Avail Use% Mounted on
文件系统                     容量  已用  可用 已用% 挂载点
/dev/mapper/webapp-webapp01   20G   33M   20G   1% /usr/share/nginx/html

逻辑卷快照

LVM 快照可保留逻辑卷某一时刻的完整数据,用于数据备份或恢复,核心特性:快照容量需不小于原 LV 容量(避免数据溢出)。

# 1. 创建快照(-s 表示快照,-n 快照名,-L 快照大小,指定原 LV)
[root@centos ~ 00:12:07]# lvcreate -s -n webapp01-snap -L 10G /dev/webapp/webapp01
  Logical volume "webapp01-snap" created.
  
 # 2. 挂载快照(查看快照中的数据)
# 快照的文件系统和原先逻辑卷的文件系统的uuid是一致的。 默认情况下,快照和原卷同一时刻只能挂载一个。
# 一定要挂载,则需要修改uuid
[root@centos ~ 00:13:12]# uuidgen
9b39d9f4-29ba-44df-80a1-4eba3d3b8a47
[root@centos ~ 00:15:30]# xfs_admin -U 9b39d9f4-29ba-44df-80a1-4eba3d3b8a47 /dev/webapp/webapp01-snap
ERROR: The filesystem has valuable metadata changes in a log which needs to
be replayed.  Mount the filesystem to replay the log, and unmount it before
re-running xfs_admin.  If you are unable to mount the filesystem, then use
the xfs_repair -L option to destroy the log and attempt a repair.
Note that destroying the log may cause corruption -- please attempt a mount
of the filesystem before doing this.

#清理日志
[root@centos ~ 00:16:00]# xfs_repair -L /dev/webapp/webapp01-snap
Phase 1 - find and verify superblock...
Phase 2 - using internal log
        - zero log...
ALERT: The filesystem has valuable metadata changes in a log which is being
destroyed because the -L option was used.
        - scan filesystem freespace and inode maps...
        - found root inode chunk
Phase 3 - for each AG...
        - scan and clear agi unlinked lists...
        - process known inodes and perform inode discovery...
        - agno = 0
        - agno = 1
        - agno = 2
        - agno = 3
        - agno = 4
        - agno = 5
        - agno = 6
        - agno = 7
        - process newly discovered inodes...
Phase 4 - check for duplicate blocks...
        - setting up duplicate extent list...
        - check for inodes claiming duplicate blocks...
        - agno = 0
        - agno = 1
        - agno = 2
        - agno = 3
        - agno = 4
        - agno = 5
        - agno = 6
        - agno = 7
Phase 5 - rebuild AG headers and trees...
        - reset superblock...
Phase 6 - check inode connectivity...
        - resetting contents of realtime bitmap and summary inodes
        - traversing filesystem ...
        - traversal finished ...
        - moving disconnected inodes to lost+found ...
Phase 7 - verify and correct link counts...
Maximum metadata LSN (1:27) is ahead of log (1:2).
Format log to cycle 4.
done

#修改成功
[root@centos ~ 00:19:20]# xfs_admin -U 9b39d9f4-29ba-44df-80a1-4eba3d3b8a47 /dev/webapp/webapp01-snap
Clearing log and setting UUID
writing all SBs
new UUID = 9b39d9f4-29ba-44df-80a1-4eba3d3b8a47

[root@centos ~ 00:21:15]# mkdir /webapp/webapp01-snap -p
[root@centos ~ 00:23:05]# mount /dev/webapp/webapp01-snap /webapp/webapp01-snap

# 3. 验证快照数据(与原 LV 一致)
[root@centos ~ 00:23:46]# ls /webapp/webapp01-snap
host.conf  hostname  hosts  hosts.allow  hosts.deny

# 4. 在快照 LV 中写入新数据(验证快照独立性)
[root@centos ~ 00:23:48]# echo hello world > /webapp/webapp01-snap/hello.txt
[root@centos ~ 00:24:10]# cat /webapp/webapp01-snap/hello.txt
hello world
Logo

有“AI”的1024 = 2048,欢迎大家加入2048 AI社区

更多推荐