2023-07-31T16:41:23.804 INFO:root:teuthology version: 0.0.1.dev172+g6114016 2023-07-31T16:41:23.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:41:33.936 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f825806d280>, signals=[15]) 2023-07-31T16:41:33.938 INFO:teuthology.lock.ops:Start node 'smithi131.front.sepia.ceph.com' reimaging 2023-07-31T16:41:33.938 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: reset os type and version on server 2023-07-31T16:41:33.938 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-07-31T16:41:43.975 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /host {"name": "smithi131"} 2023-07-31T16:41:54.058 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-07-31T16:41:59.107 DEBUG:teuthology.provision.fog.smithi131:Requesting image smithi_centos_8.stream (ID 3) 2023-07-31T16:41:59.107 DEBUG:teuthology.provision.fog.smithi131:FOG request: PUT /host/236 {"imageID": 3} 2023-07-31T16:42:03.775 INFO:teuthology.provision.fog.smithi131:Scheduling deploy of centos 8.stream 2023-07-31T16:42:03.775 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:42:03.813 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /tasktype {"name": "deploy"} 2023-07-31T16:42:03.843 DEBUG:teuthology.provision.fog.smithi131:FOG request: POST /host/236/task {"taskTypeID": 1} 2023-07-31T16:42:03.895 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:42:07.039 INFO:teuthology.orchestra.console.smithi131:Power off 2023-07-31T16:42:07.040 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-31T16:42:07.065 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-07-31T16:42:07.066 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:07.095 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-07-31T16:42:11.096 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:12.205 DEBUG:teuthology.orchestra.console.smithi131:check power output: 2023-07-31T16:42:16.206 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:17.318 DEBUG:teuthology.orchestra.console.smithi131:check power output: 2023-07-31T16:42:21.319 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:21.430 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-07-31T16:42:21.531 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-07-31T16:42:21.632 INFO:teuthology.orchestra.console.smithi131:Power on 2023-07-31T16:42:21.632 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-07-31T16:42:21.654 DEBUG:teuthology.orchestra.console.smithi131:power on output: Chassis Power Control: Up/On 2023-07-31T16:42:21.655 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:21.679 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-07-31T16:42:25.684 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:25.794 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-07-31T16:42:29.796 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T16:42:29.906 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-07-31T16:42:30.007 INFO:teuthology.orchestra.console.smithi131:Power on completed 2023-07-31T16:42:30.108 INFO:teuthology.provision.fog.smithi131:Waiting for deploy to finish 2023-07-31T16:42:30.108 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:42:45.181 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:43:05.252 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:43:25.331 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:43:40.412 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:44:00.496 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:44:20.576 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:44:35.680 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:44:54.566 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:45:11.096 DEBUG:teuthology.provision.fog.smithi131:FOG request: GET /task/active None 2023-07-31T16:45:11.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:45:14.256 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-31T16:45:20.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:45:28.336 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-31T16:45:34.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:45:37.392 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-31T16:45:43.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:45:51.472 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-31T16:45:57.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:46:21.040 WARNING:teuthology.provision.fog.smithi131:[Errno None] Unable to connect to port 22 on 172.21.15.131 2023-07-31T16:46:27.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:46:34.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-07-31T16:46:34.076 DEBUG:teuthology.orchestra.run.smithi131:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-07-31T16:46:59.450 INFO:teuthology.provision.fog.smithi131:Node is ready 2023-07-31T16:46:59.451 DEBUG:teuthology.orchestra.run.smithi131:> hostname 2023-07-31T16:46:59.474 INFO:teuthology.orchestra.run.smithi131.stdout:smithi131.front.sepia.ceph.com 2023-07-31T16:46:59.475 DEBUG:teuthology.orchestra.run.smithi131:> grep smithi131.front.sepia.ceph.com /etc/hosts 2023-07-31T16:46:59.535 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131 smithi131.front.sepia.ceph.com smithi131 2023-07-31T16:46:59.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-07-31T16:46:59.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hosts 2023-07-31T16:46:59.715 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/172.21.15.131/172.21.15.131/g' /etc/hosts 2023-07-31T16:46:59.784 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i -e 's/smithi131.front.sepia.ceph.com/smithi131/g' /etc/hostname 2023-07-31T16:46:59.853 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname smithi131 2023-07-31T16:46:59.921 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-07-31T16:46:59.979 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-07-31T16:46:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-07-31T16:46:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-07-31T16:46:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-07-31T16:46:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-07-31T16:46:59.980 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-31T16:46:59.981 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-31T16:46:59.982 INFO:teuthology.provision.fog.smithi131:Deploy complete! 2023-07-31T16:46:59.984 DEBUG:teuthology.parallel:result is None 2023-07-31T16:47:05.131 INFO:teuthology.lock.ops:Checking smithi131.front.sepia.ceph.com 2023-07-31T16:47:05.132 INFO:teuthology.lock.ops:New key found. Updating... 2023-07-31T16:47:10.166 INFO:teuthology.lock.ops:Updating [smithi131.front.sepia.ceph.com]: set os type and version on server 2023-07-31T16:47:10.166 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-31T16:47:10.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-31T16:47:15.242 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-07-31T16:47:15.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-07-31T16:47:15.377 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-07-31T16:47:15.438 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-07-31T16:47:15.438 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-07-31T16:47:15.497 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2023-07-31T16:47:15.497 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8" 2023-07-31T16:47:15.497 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2023-07-31T16:47:15.497 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 8" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2023-07-31T16:47:15.498 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-31T16:47:15.499 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-31T16:47:15.499 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-07-31T16:47:15.499 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-07-31T16:47:16.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:47:21.477 INFO:teuthology.dispatcher.supervisor:Running job 7357753 2023-07-31T16:47:21.477 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_61140164d2579c30ffff3970615e0f82e40c6470/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357753 --name yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_nfs} -- /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357753/orig.config.yaml 2023-07-31T16:47:21.481 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357753 2023-07-31T16:47:21.482 INFO:teuthology.dispatcher.supervisor:Job PID: 32411 2023-07-31T16:47:21.483 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-07-31T16:49:21.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:51:26.789 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:53:31.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:55:37.144 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:57:42.329 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T16:59:47.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:01:49.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:03:55.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:05:55.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:07:55.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:09:55.621 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:11:55.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:13:55.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:15:56.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:17:56.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:19:56.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:21:56.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-31T17:21:56.817 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-07-31T17:21:56.938 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-07-31T17:21:56.938 INFO:teuthology.nuke:Checking targets against current locks 2023-07-31T17:21:56.993 DEBUG:teuthology.nuke:shortname: smithi131 2023-07-31T17:21:56.994 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-31T17:21:57.017 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-07-31_15:32:14-rados-wip-yuri7-testing-2023-07-27-1336-quincy-distro-default-smithi/7357753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-31 16:41:22.923270', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD+p4S8OykveYBPOoIhPmK8Eu7GthopBdsz//MPg4Xbc9jbv4ATMF6TdyFtd7C5fmt/357s6OwBUynOI00mQQMZiA1mYn1xDS2n0DtgRogeXlwEZAZfu5fplc4Up0SY2UBjlLrwWlSjPVpiIuipuT8rNan2ZESWBTHUEif21IbvSfDoGdMWiCjU7aGWrP3rh9ktx2CMkFkkzZR595a0baVYCkSY1toDgenL+uFeNBhtkY13mg03dVr87n/WmJsT64U1I2ZzCBJBpNbUU6dzxuPsCkz2035o/vwO3vsnNUmw2VseL2CRYiazmxV4bkDN32AZGxcjIsZLXzkOna+hB/RJ6VHx6IRFQ4X5DZLJd/+v4bIR7is6UcR6z1g1hvFDuha8cPNLigs/oVNBASpl+HiSxM0MSpfSW/ursTfPFktpGDcI+MbqHpMbtiR9KITx7SVgpmimlSBOlsRzJOnavQ2IgIs2rR7aFZ/lGa6vdb0dzs8PFuucMw87jfq3wktdEvM='} 2023-07-31T17:21:57.075 INFO:teuthology.orchestra.console.smithi131:Power off 2023-07-31T17:21:57.075 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-31T17:21:57.095 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-07-31T17:21:57.096 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-31T17:21:57.115 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-07-31T17:21:57.216 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-07-31T17:21:57.374 INFO:teuthology.lock.ops:unlocked: smithi131.front.sepia.ceph.com