2023-12-12T18:43:44.579 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T18:43:44.580 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:43:44.695 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3c2fdff940>, signals=[15]) 2023-12-12T18:43:44.696 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2023-12-12T18:43:44.696 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2023-12-12T18:43:44.696 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-12-12T18:43:44.833 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10) 2023-12-12T18:43:44.873 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream 2023-12-12T18:43:45.165 INFO:teuthology.orchestra.console.smithi045:Power off 2023-12-12T18:43:45.165 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T18:43:45.192 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-12-12T18:43:45.193 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:43:45.218 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-12T18:43:49.222 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:43:49.332 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-12T18:43:53.335 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:43:53.446 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-12T18:43:57.450 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:43:57.561 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-12T18:43:57.661 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-12-12T18:43:57.762 INFO:teuthology.orchestra.console.smithi045:Power on 2023-12-12T18:43:57.762 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-12-12T18:43:57.784 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On 2023-12-12T18:43:57.785 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:43:57.809 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-12T18:44:01.814 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T18:44:01.926 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-12T18:44:02.026 INFO:teuthology.orchestra.console.smithi045:Power on completed 2023-12-12T18:44:02.127 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2023-12-12T18:46:33.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:46:36.098 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:46:42.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:46:45.154 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:46:51.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:46:54.242 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:47:00.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:47:03.302 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:47:09.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:47:12.390 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:47:18.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:47:21.474 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-12T18:47:27.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:48:27.540 WARNING:teuthology.provision.fog.smithi045:timed out 2023-12-12T18:48:33.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:48:33.778 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-12-12T18:48:33.778 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-12-12T18:48:34.140 INFO:teuthology.provision.fog.smithi045:Node is ready 2023-12-12T18:48:34.140 DEBUG:teuthology.orchestra.run.smithi045:> hostname 2023-12-12T18:48:34.156 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2023-12-12T18:48:34.156 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts 2023-12-12T18:48:34.211 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2023-12-12T18:48:34.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-12-12T18:48:34.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts 2023-12-12T18:48:34.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts 2023-12-12T18:48:34.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname 2023-12-12T18:48:34.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045 2023-12-12T18:48:34.564 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T18:48:34.619 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T18:48:34.620 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T18:48:34.621 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2023-12-12T18:48:34.622 DEBUG:teuthology.parallel:result is None 2023-12-12T18:48:34.791 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2023-12-12T18:48:34.791 INFO:teuthology.lock.ops:New key found. Updating... 2023-12-12T18:48:34.815 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2023-12-12T18:48:34.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-12T18:48:34.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T18:48:34.910 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-12T18:48:34.976 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-12T18:48:34.977 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-12-12T18:48:35.031 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-12-12T18:48:35.032 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-12-12T18:48:35.086 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2023-12-12T18:48:35.087 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-12T18:48:35.088 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-12T18:48:35.088 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-12T18:48:35.088 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-12-12T18:48:35.114 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:48:35.199 INFO:teuthology.dispatcher.supervisor:Running job 7488925 2023-12-12T18:48:35.200 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488925 --name yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi --description rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488925/orig.config.yaml 2023-12-12T18:48:35.203 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488925 2023-12-12T18:48:35.203 INFO:teuthology.dispatcher.supervisor:Job PID: 1141255 2023-12-12T18:48:35.204 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-12-12T18:50:35.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:52:35.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:54:35.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:56:35.877 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T18:58:36.050 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:00:36.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:02:36.390 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:04:36.562 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:06:36.742 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:08:36.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:08:36.965 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-12-12T19:08:37.036 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-12-12T19:08:37.036 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T19:08:37.081 DEBUG:teuthology.nuke:shortname: smithi045 2023-12-12T19:08:37.082 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T19:08:37.104 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-12_16:18:21-rados-wip-yuri-testing-2023-12-11-1524-distro-default-smithi/7488925', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 18:43:43.781393', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIoPsxSPibiJ6ANjS+0DzY4qLv9y5BuNxBc7u5U4gGRzjpFgwsWd6qUeXn6IG2yQCvj+RTyadxmS8DOdpx2xkRs='} 2023-12-12T19:08:37.155 INFO:teuthology.orchestra.console.smithi045:Power off 2023-12-12T19:08:37.156 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T19:08:37.176 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-12-12T19:08:37.176 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:08:37.197 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-12T19:08:37.298 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-12-12T19:08:37.445 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com