创卷失败导致创建虚机失败

Viewed 8

cinder-volume日志

2023-07-24 16:31:54.785 38078 WARNING py.warnings [req-d6e042fd-2399-4476-b1c4-eeef818ef32d 29db1b4d906b4624841eeb6151f9e150 df6ebdf472b04443adbf82c4617199b4 - - -] /usr/lib/python2.7/site-packages/urllib3/connectionpool.py:852: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
  InsecureRequestWarning)
: UnityThinCloneLimitExceededError: Number of thin clones of base LUN exceeds system limit. (Error Code:0x670153f)
2023-07-24 16:31:55.421 38078 ERROR cinder.zonemanager.drivers.brocade.brcd_http_fc_zone_client [req-d6e042fd-2399-4476-b1c4-eeef818ef32d 29db1b4d906b4624841eeb6151f9e150 df6ebdf472b04443adbf82c4617199b4 - - -] Error while getting nvp value: substring not found.
2023-07-24 16:31:56.100 38078 INFO os_brick.initiator.connectors.fibre_channel [-] Fibre Channel volume device not yet found. Will rescan & retry.  Try number: 0.
2023-07-24 16:31:58.104 38078 INFO os_brick.initiator.connectors.fibre_channel [-] Fibre Channel volume device not yet found. Will rescan & retry.  Try number: 1.
2023-07-24 16:32:00.100 38078 INFO os_brick.initiator.connectors.fibre_channel [-] Fibre Channel volume device not yet found. Will rescan & retry.  Try number: 2.
2023-07-24 16:32:02.096 38078 ERROR os_brick.initiator.connectors.fibre_channel [-] Fibre Channel volume device not found.
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall [-] Fixed interval looping call 'os_brick.initiator.connectors.fibre_channel._wait_for_device_discovery' failed: NoFibreChannelVolumeDeviceFound: Unable to find a Fibre Channel volume device.
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall Traceback (most recent call last):
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/site-packages/oslo_service/loopingcall.py", line 150, in _run_loop
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall     result = func(*self.args, **self.kw)
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall   File "/usr/lib/python2.7/site-packages/os_brick/initiator/connectors/fibre_channel.py", line 230, in _wait_for_device_discovery
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall     raise exception.NoFibreChannelVolumeDeviceFound()
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall NoFibreChannelVolumeDeviceFound: Unable to find a Fibre Channel volume device.
2023-07-24 16:32:02.098 38078 ERROR oslo.service.loopingcall
1 Answers

根据日志可以看到,这是因为后端存储的thin clones of base LUN exceeds system limit指标超额了。
因为cinder在使用镜像创建卷的第一次会将镜像下载到存储同时创建一个卷A,后续使用这个镜像创建的卷都是从这个卷A来克隆的,但是EMC的默认thin clones of base LUN exceeds system limit值为16,即使用同一个卷A只能最多克隆16个卷,即最多只能创建16台虚机,后续的虚机都会因为这个问题而失败。

解决办法:
删掉卷A,重新创建虚机即可。