2023-07-29T20:08:30.412 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-29T20:08:30.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:08:30.583 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe785db8f70>, signals=[15]) 2023-07-29T20:08:30.585 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging 2023-07-29T20:08:30.585 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:30.586 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-29T20:08:30.611 INFO:teuthology.lock.ops:Start node 'smithi043.front.sepia.ceph.com' reimaging 2023-07-29T20:08:30.612 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:30.612 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-07-29T20:08:30.614 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /host {"name": "smithi038"} 2023-07-29T20:08:30.636 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging 2023-07-29T20:08:30.637 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server 2023-07-29T20:08:30.637 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-29T20:08:30.638 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /host {"name": "smithi043"} 2023-07-29T20:08:30.662 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /host {"name": "smithi093"} 2023-07-29T20:08:30.696 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-29T20:08:30.717 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-29T20:08:30.725 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-07-29T20:08:30.728 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_9.stream (ID 10) 2023-07-29T20:08:30.728 DEBUG:teuthology.provision.fog.smithi038:FOG request: PUT /host/143 {"imageID": 10} 2023-07-29T20:08:30.766 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_9.stream (ID 10) 2023-07-29T20:08:30.768 DEBUG:teuthology.provision.fog.smithi093:FOG request: PUT /host/198 {"imageID": 10} 2023-07-29T20:08:30.771 DEBUG:teuthology.provision.fog.smithi043:Requesting image smithi_centos_9.stream (ID 10) 2023-07-29T20:08:30.772 DEBUG:teuthology.provision.fog.smithi043:FOG request: PUT /host/148 {"imageID": 10} 2023-07-29T20:08:30.781 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 9.stream 2023-07-29T20:08:30.782 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:08:30.813 INFO:teuthology.provision.fog.smithi043:Scheduling deploy of centos 9.stream 2023-07-29T20:08:30.813 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:08:30.820 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 9.stream 2023-07-29T20:08:30.821 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:08:30.839 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:30.877 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:30.884 DEBUG:teuthology.provision.fog.smithi038:FOG request: POST /host/143/task {"taskTypeID": 1} 2023-07-29T20:08:30.887 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /tasktype {"name": "deploy"} 2023-07-29T20:08:30.912 DEBUG:teuthology.provision.fog.smithi093:FOG request: POST /host/198/task {"taskTypeID": 1} 2023-07-29T20:08:30.922 DEBUG:teuthology.provision.fog.smithi043:FOG request: POST /host/148/task {"taskTypeID": 1} 2023-07-29T20:08:30.943 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:08:30.975 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:08:30.980 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:08:31.061 INFO:teuthology.orchestra.console.smithi038:Power off 2023-07-29T20:08:31.061 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:31.077 INFO:teuthology.orchestra.console.smithi043:Power off 2023-07-29T20:08:31.078 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:31.092 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-29T20:08:31.093 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T20:08:31.103 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:31.103 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.112 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:31.112 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.122 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-29T20:08:31.123 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.132 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-07-29T20:08:31.133 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-07-29T20:08:31.143 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T20:08:31.233 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-07-29T20:08:31.234 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-07-29T20:08:31.244 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-29T20:08:31.335 INFO:teuthology.orchestra.console.smithi038:Power on 2023-07-29T20:08:31.335 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:31.344 INFO:teuthology.orchestra.console.smithi043:Power on 2023-07-29T20:08:31.345 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:31.354 INFO:teuthology.orchestra.console.smithi093:Power on 2023-07-29T20:08:31.355 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-29T20:08:31.364 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:31.365 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.375 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:31.376 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.382 DEBUG:teuthology.orchestra.console.smithi043:power on output: Chassis Power Control: Up/On 2023-07-29T20:08:31.383 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:31.393 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-07-29T20:08:31.396 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T20:08:31.413 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-07-29T20:08:35.396 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.404 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.415 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:35.506 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on 2023-07-29T20:08:35.515 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T20:08:35.525 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-07-29T20:08:35.608 INFO:teuthology.orchestra.console.smithi038:Power on completed 2023-07-29T20:08:35.709 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish 2023-07-29T20:08:35.709 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:08:39.520 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:39.529 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T20:08:39.631 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-07-29T20:08:39.639 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is on 2023-07-29T20:08:39.733 INFO:teuthology.orchestra.console.smithi093:Power on completed 2023-07-29T20:08:39.741 INFO:teuthology.orchestra.console.smithi043:Power on completed 2023-07-29T20:08:39.834 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2023-07-29T20:08:39.835 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:08:39.841 INFO:teuthology.provision.fog.smithi043:Waiting for deploy to finish 2023-07-29T20:08:39.842 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:08:50.820 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:08:55.022 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:08:55.024 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:09:06.024 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:09:10.212 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:09:10.273 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:09:21.231 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:09:25.436 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:09:25.480 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:09:36.431 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:09:40.628 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:09:40.673 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:09:51.621 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:09:55.828 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:09:55.885 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:10:06.853 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:10:11.070 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:10:11.125 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:10:22.188 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:10:26.348 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:10:26.386 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:10:37.552 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:10:41.713 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:10:41.723 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:10:52.932 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:10:57.313 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:10:57.321 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:11:08.288 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:11:12.777 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:11:12.779 DEBUG:teuthology.provision.fog.smithi043:FOG request: GET /task/active None 2023-07-29T20:11:13.255 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:16.336 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-29T20:11:22.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:23.651 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:11:25.424 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-29T20:11:28.250 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:11:31.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:34.480 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-29T20:11:39.067 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:11:40.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:43.536 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-29T20:11:43.636 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:11:49.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:52.624 WARNING:teuthology.provision.fog.smithi043:[Errno None] Unable to connect to port 22 on 172.21.15.43 2023-07-29T20:11:54.443 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:11:58.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:11:59.044 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:12:09.870 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:12:14.482 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:12:25.278 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:12:29.892 DEBUG:teuthology.provision.fog.smithi093:FOG request: GET /task/active None 2023-07-29T20:12:30.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:33.424 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:12:39.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:40.732 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:12:42.480 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:12:48.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:51.536 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:12:56.133 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:12:57.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:12:58.631 WARNING:teuthology.provision.fog.smithi043:timed out 2023-07-29T20:13:00.592 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:13:04.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:04.875 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:13:04.876 DEBUG:teuthology.orchestra.run.smithi043:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:13:05.232 INFO:teuthology.provision.fog.smithi043:Node is ready 2023-07-29T20:13:05.232 DEBUG:teuthology.orchestra.run.smithi043:> hostname 2023-07-29T20:13:05.247 INFO:teuthology.orchestra.run.smithi043.stdout:smithi043.front.sepia.ceph.com 2023-07-29T20:13:05.247 DEBUG:teuthology.orchestra.run.smithi043:> grep smithi043.front.sepia.ceph.com /etc/hosts 2023-07-29T20:13:05.302 INFO:teuthology.orchestra.run.smithi043.stdout:172.21.15.43 smithi043.front.sepia.ceph.com smithi043 2023-07-29T20:13:05.303 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-07-29T20:13:05.431 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hosts 2023-07-29T20:13:05.462 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/172.21.15.43/172.21.15.43/g' /etc/hosts 2023-07-29T20:13:05.532 DEBUG:teuthology.orchestra.run.smithi043:> sudo sed -i -e 's/smithi043.front.sepia.ceph.com/smithi043/g' /etc/hostname 2023-07-29T20:13:05.602 DEBUG:teuthology.orchestra.run.smithi043:> sudo hostname smithi043 2023-07-29T20:13:05.672 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-07-29T20:13:05.726 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:13:05.727 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:13:05.728 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:13:05.729 INFO:teuthology.provision.fog.smithi043:Deploy complete! 2023-07-29T20:13:05.730 DEBUG:teuthology.parallel:result is None 2023-07-29T20:13:06.595 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:09.648 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:13:11.624 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:13:15.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:18.704 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93 2023-07-29T20:13:24.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:13:26.964 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:13:42.288 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:13:57.708 DEBUG:teuthology.provision.fog.smithi038:FOG request: GET /task/active None 2023-07-29T20:13:58.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:01.232 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:07.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:10.288 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:16.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:19.344 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:24.718 WARNING:teuthology.provision.fog.smithi093:timed out 2023-07-29T20:14:25.346 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:28.400 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:30.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:30.956 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:14:30.956 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:14:31.264 INFO:teuthology.provision.fog.smithi093:Node is ready 2023-07-29T20:14:31.265 DEBUG:teuthology.orchestra.run.smithi093:> hostname 2023-07-29T20:14:31.278 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2023-07-29T20:14:31.279 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2023-07-29T20:14:31.334 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2023-07-29T20:14:31.334 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-29T20:14:31.458 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2023-07-29T20:14:31.486 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2023-07-29T20:14:31.552 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2023-07-29T20:14:31.619 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2023-07-29T20:14:31.684 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-29T20:14:31.737 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-29T20:14:31.737 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-29T20:14:31.738 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:14:31.739 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:14:31.739 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:14:31.739 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:14:31.739 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:14:31.739 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:14:31.739 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2023-07-29T20:14:31.740 DEBUG:teuthology.parallel:result is None 2023-07-29T20:14:34.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:37.456 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:43.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:14:46.544 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38 2023-07-29T20:14:52.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:15:52.591 WARNING:teuthology.provision.fog.smithi038:timed out 2023-07-29T20:15:58.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:15:58.831 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-29T20:15:58.831 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-29T20:15:59.190 INFO:teuthology.provision.fog.smithi038:Node is ready 2023-07-29T20:15:59.190 DEBUG:teuthology.orchestra.run.smithi038:> hostname 2023-07-29T20:15:59.206 INFO:teuthology.orchestra.run.smithi038.stdout:smithi038.front.sepia.ceph.com 2023-07-29T20:15:59.206 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi038.front.sepia.ceph.com /etc/hosts 2023-07-29T20:15:59.262 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.38 smithi038.front.sepia.ceph.com smithi038 2023-07-29T20:15:59.262 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-29T20:15:59.376 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hosts 2023-07-29T20:15:59.409 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.38/172.21.15.38/g' /etc/hosts 2023-07-29T20:15:59.480 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi038.front.sepia.ceph.com/smithi038/g' /etc/hostname 2023-07-29T20:15:59.551 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038 2023-07-29T20:15:59.621 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-29T20:15:59.675 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-29T20:15:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2023-07-29T20:15:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-29T20:15:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:15:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2023-07-29T20:15:59.676 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:15:59.677 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:15:59.678 INFO:teuthology.provision.fog.smithi038:Deploy complete! 2023-07-29T20:15:59.678 DEBUG:teuthology.parallel:result is None 2023-07-29T20:15:59.889 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com 2023-07-29T20:15:59.890 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T20:15:59.915 INFO:teuthology.lock.ops:Checking smithi043.front.sepia.ceph.com 2023-07-29T20:15:59.915 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T20:15:59.940 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2023-07-29T20:15:59.940 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-29T20:15:59.966 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server 2023-07-29T20:15:59.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-29T20:15:59.967 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:16:00.058 DEBUG:teuthology.orchestra.run.smithi038:> true 2023-07-29T20:16:00.126 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com' 2023-07-29T20:16:00.126 DEBUG:teuthology.orchestra.run.smithi038:> uname -m 2023-07-29T20:16:00.180 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64 2023-07-29T20:16:00.181 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release 2023-07-29T20:16:00.234 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="9" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="9" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:16:00.235 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:16:00.236 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:16:00.237 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server 2023-07-29T20:16:00.257 INFO:teuthology.lock.ops:Updating [smithi043.front.sepia.ceph.com]: set os type and version on server 2023-07-29T20:16:00.257 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-07-29T20:16:00.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi043.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:16:00.355 DEBUG:teuthology.orchestra.run.smithi043:> true 2023-07-29T20:16:00.542 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi043.front.sepia.ceph.com' 2023-07-29T20:16:00.542 DEBUG:teuthology.orchestra.run.smithi043:> uname -m 2023-07-29T20:16:00.596 INFO:teuthology.orchestra.run.smithi043.stdout:x86_64 2023-07-29T20:16:00.597 DEBUG:teuthology.orchestra.run.smithi043:> cat /etc/os-release 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:NAME="CentOS Stream" 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION="9" 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:ID="centos" 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:VERSION_ID="9" 2023-07-29T20:16:00.651 INFO:teuthology.orchestra.run.smithi043.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:ANSI_COLOR="0;31" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:16:00.652 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:16:00.653 INFO:teuthology.orchestra.run.smithi043.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:16:00.653 INFO:teuthology.lock.ops:Updating smithi043.front.sepia.ceph.com on lock server 2023-07-29T20:16:00.673 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2023-07-29T20:16:00.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T20:16:00.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-29T20:16:00.756 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-07-29T20:16:00.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-07-29T20:16:00.930 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-07-29T20:16:00.983 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-07-29T20:16:00.984 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-07-29T20:16:01.037 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9" 2023-07-29T20:16:01.038 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-07-29T20:16:01.039 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-29T20:16:01.040 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-07-29T20:16:01.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:16:01.160 INFO:teuthology.dispatcher.supervisor:Running job 7357460 2023-07-29T20:16:01.160 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460 --name yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi --description rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{centos_latest} thrashers/cache thrashosds-health workloads/rbd_nbd_diff_continuous} -- /home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460/orig.config.yaml 2023-07-29T20:16:01.163 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460 2023-07-29T20:16:01.164 INFO:teuthology.dispatcher.supervisor:Job PID: 1368 2023-07-29T20:16:01.165 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-29T20:18:01.264 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:20:01.444 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:22:01.620 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:24:01.814 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:26:01.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:28:02.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:30:02.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:32:02.501 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:34:02.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:36:02.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:38:03.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:40:03.172 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:42:03.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:44:03.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:46:03.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:48:04.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:50:04.341 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:52:04.518 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:54:04.680 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:56:04.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T20:58:05.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:00:05.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:02:05.391 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:04:05.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:06:05.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:08:05.906 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:10:06.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:12:06.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:14:06.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:16:21.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:18:26.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:20:31.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:22:37.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:24:42.292 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:26:44.173 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:28:49.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:30:54.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:32:59.754 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:35:04.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:37:10.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:39:15.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:41:20.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:43:25.717 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:45:30.892 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:47:36.079 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:49:41.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:51:41.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:53:46.610 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:55:51.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T21:57:56.942 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:00:02.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:02:07.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:04:07.760 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:06:10.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:08:15.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:10:20.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:12:20.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:14:25.973 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:16:26.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:18:31.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:20:36.488 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:22:41.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:24:46.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:26:47.438 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:28:49.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:30:50.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:32:55.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:34:59.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:37:04.953 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:39:10.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:41:10.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:43:15.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:45:20.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:47:22.720 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:49:22.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:51:28.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:53:32.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:55:38.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:57:38.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T22:59:38.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:01:38.660 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:03:38.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:05:38.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:07:39.175 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:09:39.311 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:11:39.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:13:39.649 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:15:39.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:17:39.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:19:40.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:21:40.332 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:23:40.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:25:40.675 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:27:40.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:29:41.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:31:41.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:33:41.348 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:35:41.521 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:37:41.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:39:41.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-29T23:39:41.927 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-29T23:39:42.133 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-29T23:39:42.134 INFO:teuthology.nuke:Checking targets against current locks 2023-07-29T23:39:42.189 DEBUG:teuthology.nuke:shortname: smithi038 2023-07-29T23:39:42.189 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T23:39:42.213 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 20:08:29.515105', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKQZuIXmafSFmcCWLYZaQbBxcvC97rHyBuRnrX7HHT7A9WWizfEJtrIMcWTHkvzy10Mkr7rRlnnE5nXbF8QFMzs='} 2023-07-29T23:39:42.216 DEBUG:teuthology.nuke:shortname: smithi043 2023-07-29T23:39:42.217 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T23:39:42.233 DEBUG:teuthology.nuke:shortname: smithi093 2023-07-29T23:39:42.233 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-29T23:39:42.242 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi043.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 20:08:29.513599', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPQYWpKnGyPA2cjqoEkyyRWn8Wk3G7qnvJpCTExyYQGb+N8jzcrRxFU9ggSfJAbVhqMljLDXTx1mHBdwj46d8Jc='} 2023-07-29T23:39:42.258 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-29_19:50:08-rbd-reef-release-distro-default-smithi/7357460', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-29 20:08:29.516507', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE07jUDTlpfZar53rm3l/qTt8VQr/YbwvAmFXf73vAO030WcSDYutShxEJSmET+bC7o8qsdI2/4sj8chrfSQfAA='} 2023-07-29T23:39:42.266 INFO:teuthology.orchestra.console.smithi038:Power off 2023-07-29T23:39:42.267 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T23:39:42.294 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off 2023-07-29T23:39:42.295 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T23:39:42.310 INFO:teuthology.orchestra.console.smithi043:Power off 2023-07-29T23:39:42.311 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T23:39:42.324 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off 2023-07-29T23:39:42.334 DEBUG:teuthology.orchestra.console.smithi043:power off output: Chassis Power Control: Down/Off 2023-07-29T23:39:42.334 DEBUG:teuthology.orchestra.console.smithi043:pexpect command: ipmitool -H smithi043.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T23:39:42.351 INFO:teuthology.orchestra.console.smithi093:Power off 2023-07-29T23:39:42.352 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-29T23:39:42.362 DEBUG:teuthology.orchestra.console.smithi043:check power output: Chassis Power is off 2023-07-29T23:39:42.372 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-07-29T23:39:42.372 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-29T23:39:42.393 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-07-29T23:39:42.426 INFO:teuthology.orchestra.console.smithi038:Power off completed 2023-07-29T23:39:42.463 INFO:teuthology.orchestra.console.smithi043:Power off completed 2023-07-29T23:39:42.494 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-07-29T23:39:42.584 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com 2023-07-29T23:39:42.609 INFO:teuthology.lock.ops:unlocked: smithi043.front.sepia.ceph.com 2023-07-29T23:39:42.642 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com