2023-08-07T19:46:22.671 INFO:root:teuthology version: 0.0.1.dev179+gce5f6d5 2023-08-07T19:46:22.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T19:46:22.813 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f869da25ee0>, signals=[15]) 2023-08-07T19:46:22.816 INFO:teuthology.lock.ops:Start node 'smithi069.front.sepia.ceph.com' reimaging 2023-08-07T19:46:22.817 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T19:46:22.817 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-07T19:46:22.841 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-08-07T19:46:22.842 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T19:46:22.842 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-08-07T19:46:22.844 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /host {"name": "smithi069"} 2023-08-07T19:46:22.866 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-08-07T19:46:22.914 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T19:46:22.938 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T19:46:22.953 DEBUG:teuthology.provision.fog.smithi069:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T19:46:22.954 DEBUG:teuthology.provision.fog.smithi069:FOG request: PUT /host/174 {"imageID": 10} 2023-08-07T19:46:22.992 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T19:46:22.992 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 10} 2023-08-07T19:46:23.006 INFO:teuthology.provision.fog.smithi069:Scheduling deploy of centos 9.stream 2023-08-07T19:46:23.007 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:46:23.037 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream 2023-08-07T19:46:23.038 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:46:23.064 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T19:46:23.090 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T19:46:23.097 DEBUG:teuthology.provision.fog.smithi069:FOG request: POST /host/174/task {"taskTypeID": 1} 2023-08-07T19:46:23.125 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-08-07T19:46:23.162 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:46:23.185 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:46:23.255 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-07T19:46:23.256 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T19:46:23.275 INFO:teuthology.orchestra.console.smithi107:Power off 2023-08-07T19:46:23.276 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T19:46:23.286 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-07T19:46:23.287 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:23.297 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-08-07T19:46:23.298 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:23.314 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-07T19:46:23.320 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-07T19:46:27.318 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:27.327 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:27.429 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-07T19:46:27.438 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-07T19:46:31.432 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:31.442 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:31.544 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-07T19:46:31.554 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T19:46:31.646 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-07T19:46:31.656 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-08-07T19:46:31.748 INFO:teuthology.orchestra.console.smithi069:Power on 2023-08-07T19:46:31.748 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T19:46:31.757 INFO:teuthology.orchestra.console.smithi107:Power on 2023-08-07T19:46:31.757 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T19:46:31.771 DEBUG:teuthology.orchestra.console.smithi069:power on output: Chassis Power Control: Up/On 2023-08-07T19:46:31.771 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:31.781 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-08-07T19:46:31.781 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:31.793 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-07T19:46:31.804 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T19:46:35.796 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:35.805 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:35.908 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-08-07T19:46:35.917 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T19:46:36.009 INFO:teuthology.orchestra.console.smithi069:Power on completed 2023-08-07T19:46:36.109 INFO:teuthology.provision.fog.smithi069:Waiting for deploy to finish 2023-08-07T19:46:36.110 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:46:39.920 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T19:46:40.031 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-07T19:46:40.132 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-08-07T19:46:40.233 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-08-07T19:46:40.234 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:46:51.184 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:46:55.308 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:47:06.262 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:47:10.377 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:47:21.344 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:47:25.446 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:47:36.431 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:47:40.524 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:47:51.528 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:47:55.604 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:48:06.608 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:48:10.676 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:48:21.706 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:48:25.752 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:48:36.796 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:48:40.860 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:48:51.888 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:48:55.968 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:49:06.976 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:49:11.062 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:49:22.060 DEBUG:teuthology.provision.fog.smithi069:FOG request: GET /task/active None 2023-08-07T19:49:22.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:25.200 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:49:26.168 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T19:49:26.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:29.328 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:49:31.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:34.256 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:49:35.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:38.384 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:49:40.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:43.316 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:49:44.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:47.440 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:49:49.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:52.400 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:49:53.442 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:49:56.496 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:49:58.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:01.456 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:50:02.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:05.552 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:50:07.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:10.516 WARNING:teuthology.provision.fog.smithi069:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-08-07T19:50:11.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:14.608 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T19:50:16.520 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:20.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:50:48.415 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T19:50:48.416 DEBUG:teuthology.orchestra.run.smithi069:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T19:51:09.164 INFO:teuthology.provision.fog.smithi069:Node is ready 2023-08-07T19:51:09.165 DEBUG:teuthology.orchestra.run.smithi069:> hostname 2023-08-07T19:51:09.182 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069.front.sepia.ceph.com 2023-08-07T19:51:09.182 DEBUG:teuthology.orchestra.run.smithi069:> grep smithi069.front.sepia.ceph.com /etc/hosts 2023-08-07T19:51:09.238 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69 smithi069.front.sepia.ceph.com smithi069 2023-08-07T19:51:09.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-07T19:51:09.363 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hosts 2023-08-07T19:51:09.394 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/172.21.15.69/172.21.15.69/g' /etc/hosts 2023-08-07T19:51:09.464 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i -e 's/smithi069.front.sepia.ceph.com/smithi069/g' /etc/hostname 2023-08-07T19:51:09.534 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname smithi069 2023-08-07T19:51:09.602 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-07T19:51:09.657 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-08-07T19:51:09.658 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-08-07T19:51:09.658 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-08-07T19:51:09.658 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-08-07T19:51:09.658 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-08-07T19:51:09.658 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T19:51:09.659 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T19:51:09.660 INFO:teuthology.provision.fog.smithi069:Deploy complete! 2023-08-07T19:51:09.661 DEBUG:teuthology.parallel:result is None 2023-08-07T19:51:20.624 WARNING:teuthology.provision.fog.smithi107:timed out 2023-08-07T19:51:26.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:51:26.810 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T19:51:26.811 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T19:51:27.133 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-08-07T19:51:27.133 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-08-07T19:51:27.147 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-08-07T19:51:27.148 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-08-07T19:51:27.202 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-08-07T19:51:27.202 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-08-07T19:51:27.322 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-08-07T19:51:27.349 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-08-07T19:51:27.417 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-08-07T19:51:27.483 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-08-07T19:51:27.549 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-08-07T19:51:27.604 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-08-07T19:51:27.604 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-08-07T19:51:27.605 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-08-07T19:51:27.605 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-08-07T19:51:27.605 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-08-07T19:51:27.605 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-08-07T19:51:27.606 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T19:51:27.606 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-08-07T19:51:27.606 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-08-07T19:51:27.607 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T19:51:27.607 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-08-07T19:51:27.607 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T19:51:27.607 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T19:51:27.608 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T19:51:27.608 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-08-07T19:51:27.609 DEBUG:teuthology.parallel:result is None 2023-08-07T19:51:27.752 INFO:teuthology.lock.ops:Checking smithi069.front.sepia.ceph.com 2023-08-07T19:51:27.753 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T19:51:27.780 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-08-07T19:51:27.780 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T19:51:27.806 INFO:teuthology.lock.ops:Updating [smithi069.front.sepia.ceph.com]: set os type and version on server 2023-08-07T19:51:27.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-07T19:51:27.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:51:27.891 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-08-07T19:51:28.058 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-08-07T19:51:28.059 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-08-07T19:51:28.113 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-08-07T19:51:28.113 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-08-07T19:51:28.166 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T19:51:28.167 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T19:51:28.168 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T19:51:28.169 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-08-07T19:51:28.188 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-08-07T19:51:28.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-07T19:51:28.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T19:51:28.272 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-08-07T19:51:28.297 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-07T19:51:28.297 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-08-07T19:51:28.351 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-08-07T19:51:28.352 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-08-07T19:51:28.406 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-08-07T19:51:28.406 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-08-07T19:51:28.406 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-08-07T19:51:28.407 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-08-07T19:51:28.407 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-08-07T19:51:28.407 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-08-07T19:51:28.407 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T19:51:28.408 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T19:51:28.409 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-08-07T19:51:28.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T19:51:28.532 INFO:teuthology.dispatcher.supervisor:Running job 7360700 2023-08-07T19:51:28.532 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_ce5f6d589a888dfc88977261bfa1ed63441de8fb/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360700 --name rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/acls} -- /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360700/orig.config.yaml 2023-08-07T19:51:28.536 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360700 2023-08-07T19:51:28.537 INFO:teuthology.dispatcher.supervisor:Job PID: 13030 2023-08-07T19:51:28.537 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-07T19:53:28.636 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T19:55:28.817 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T19:57:28.985 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T19:59:29.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:01:29.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:03:29.509 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:05:29.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:07:29.857 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:09:30.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:11:30.201 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:13:30.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:15:30.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:15:30.615 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-07T20:15:30.720 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-07T20:15:30.721 INFO:teuthology.nuke:Checking targets against current locks 2023-08-07T20:15:30.765 DEBUG:teuthology.nuke:shortname: smithi069 2023-08-07T20:15:30.766 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T20:15:30.790 DEBUG:teuthology.nuke:shortname: smithi107 2023-08-07T20:15:30.790 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T20:15:30.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360700', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 19:46:21.769122', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIaQ1x9Dkh6crxZYGdlFn/e9f+43hp2T135mkgbh7f5KtR2SZZ9JJ2okLApI7Uw/pveu9IQn/gM6s6kGmYYlHhE='} 2023-08-07T20:15:30.815 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_17:52:17-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7360700', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 19:46:21.770509', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHIgy+gzaXTpMvyXnTs/Dc7f2mU6vdaBDZFHsDrrPTvFrClQ4eW2xU+S2EOkLome+lhRYyzadRq7kycCSHI7wTI='} 2023-08-07T20:15:30.843 INFO:teuthology.orchestra.console.smithi069:Power off 2023-08-07T20:15:30.845 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:15:30.867 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-08-07T20:15:30.867 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:15:30.885 INFO:teuthology.orchestra.console.smithi107:Power off 2023-08-07T20:15:30.886 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:15:30.898 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-08-07T20:15:30.913 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-08-07T20:15:30.913 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:15:30.935 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T20:15:30.999 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-08-07T20:15:31.037 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-08-07T20:15:31.147 INFO:teuthology.lock.ops:unlocked: smithi069.front.sepia.ceph.com 2023-08-07T20:15:31.181 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com