2023-08-30T14:33:52.265 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-30T14:33:52.266 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:33:52.358 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fec25cca1f0>, signals=[15]) 2023-08-30T14:33:52.360 INFO:teuthology.lock.ops:Start node 'smithi059.front.sepia.ceph.com' reimaging 2023-08-30T14:33:52.360 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T14:33:52.360 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-30T14:33:52.380 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /host {"name": "smithi059"} 2023-08-30T14:33:52.452 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-30T14:33:52.504 DEBUG:teuthology.provision.fog.smithi059:Requesting image smithi_centos_9.stream (ID 10) 2023-08-30T14:33:52.504 DEBUG:teuthology.provision.fog.smithi059:FOG request: PUT /host/164 {"imageID": 10} 2023-08-30T14:33:52.546 INFO:teuthology.provision.fog.smithi059:Scheduling deploy of centos 9.stream 2023-08-30T14:33:52.546 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:33:52.727 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T14:33:52.764 DEBUG:teuthology.provision.fog.smithi059:FOG request: POST /host/164/task {"taskTypeID": 1} 2023-08-30T14:33:52.823 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:33:53.073 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-30T14:33:53.074 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:33:53.094 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-30T14:33:53.095 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:53.116 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-30T14:33:57.121 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:33:57.230 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-30T14:34:01.234 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:01.342 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T14:34:01.443 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-30T14:34:01.544 INFO:teuthology.orchestra.console.smithi059:Power on 2023-08-30T14:34:01.544 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T14:34:01.563 DEBUG:teuthology.orchestra.console.smithi059:power on output: Chassis Power Control: Up/On 2023-08-30T14:34:01.564 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:01.585 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T14:34:05.590 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:05.698 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T14:34:09.703 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:34:09.811 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-08-30T14:34:09.912 INFO:teuthology.orchestra.console.smithi059:Power on completed 2023-08-30T14:34:10.013 INFO:teuthology.provision.fog.smithi059:Waiting for deploy to finish 2023-08-30T14:34:10.013 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:34:25.235 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:34:40.467 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:34:55.695 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:35:10.934 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:35:26.186 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:35:41.419 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:35:56.754 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:36:12.172 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:36:27.590 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:36:42.968 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:36:58.350 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:37:13.830 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:37:29.490 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:37:45.249 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:38:00.680 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:38:15.982 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:38:31.283 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:38:46.710 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:39:01.973 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:39:17.210 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:39:32.554 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:39:47.835 DEBUG:teuthology.provision.fog.smithi059:FOG request: GET /task/active None 2023-08-30T14:39:48.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:39:51.130 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-30T14:39:57.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:00.186 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-30T14:40:06.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:09.242 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-30T14:40:15.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:18.330 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-30T14:40:24.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:40:27.386 WARNING:teuthology.provision.fog.smithi059:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-08-30T14:40:33.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:33.455 WARNING:teuthology.provision.fog.smithi059:timed out 2023-08-30T14:41:39.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:39.683 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T14:41:39.684 DEBUG:teuthology.orchestra.run.smithi059:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T14:41:39.986 INFO:teuthology.provision.fog.smithi059:Node is ready 2023-08-30T14:41:39.987 DEBUG:teuthology.orchestra.run.smithi059:> hostname 2023-08-30T14:41:40.001 INFO:teuthology.orchestra.run.smithi059.stdout:smithi059.front.sepia.ceph.com 2023-08-30T14:41:40.001 DEBUG:teuthology.orchestra.run.smithi059:> grep smithi059.front.sepia.ceph.com /etc/hosts 2023-08-30T14:41:40.057 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59 smithi059.front.sepia.ceph.com smithi059 2023-08-30T14:41:40.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-30T14:41:40.181 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hosts 2023-08-30T14:41:40.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/172.21.15.59/172.21.15.59/g' /etc/hosts 2023-08-30T14:41:40.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i -e 's/smithi059.front.sepia.ceph.com/smithi059/g' /etc/hostname 2023-08-30T14:41:40.355 DEBUG:teuthology.orchestra.run.smithi059:> sudo hostname smithi059 2023-08-30T14:41:40.426 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-30T14:41:40.480 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-30T14:41:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-08-30T14:41:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-30T14:41:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:41:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-08-30T14:41:40.481 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:41:40.482 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:41:40.482 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-30T14:41:40.482 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:41:40.482 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:41:40.482 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:41:40.483 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:41:40.483 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:41:40.483 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:41:40.484 INFO:teuthology.provision.fog.smithi059:Deploy complete! 2023-08-30T14:41:40.485 DEBUG:teuthology.parallel:result is None 2023-08-30T14:41:40.629 INFO:teuthology.lock.ops:Checking smithi059.front.sepia.ceph.com 2023-08-30T14:41:40.629 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T14:41:40.657 INFO:teuthology.lock.ops:Updating [smithi059.front.sepia.ceph.com]: set os type and version on server 2023-08-30T14:41:40.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T14:41:40.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T14:41:40.753 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-08-30T14:41:40.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-08-30T14:41:40.824 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-08-30T14:41:40.878 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-08-30T14:41:40.878 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-08-30T14:41:40.933 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="CentOS Stream" 2023-08-30T14:41:40.934 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="9" 2023-08-30T14:41:40.934 INFO:teuthology.orchestra.run.smithi059.stdout:ID="centos" 2023-08-30T14:41:40.934 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="rhel fedora" 2023-08-30T14:41:40.934 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="9" 2023-08-30T14:41:40.934 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el9" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:LOGO="fedora-logo-icon" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://centos.org/" 2023-08-30T14:41:40.935 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T14:41:40.936 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-30T14:41:40.936 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T14:41:40.936 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-08-30T14:41:40.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:41:41.039 INFO:teuthology.dispatcher.supervisor:Running job 7384332 2023-08-30T14:41:41.040 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384332 --name yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi --description rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_latest}} -- /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384332/orig.config.yaml 2023-08-30T14:41:41.043 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384332 2023-08-30T14:41:41.044 INFO:teuthology.dispatcher.supervisor:Job PID: 1410194 2023-08-30T14:41:41.044 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T14:43:41.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T14:43:41.204 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T14:43:41.272 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T14:43:41.273 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T14:43:41.313 DEBUG:teuthology.nuke:shortname: smithi059 2023-08-30T14:43:41.314 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T14:43:41.335 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-30_14:31:48-rados-wip-yuri8-testing-2023-08-28-1340-distro-default-smithi/7384332', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 14:33:51.541189', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTIfO1o2lXWMcmx2rPCY/5i9m17RglKpYgI49rFWwgU3bG1iVStyHfTJOd4pgebIoAb2YgYlAoLDvdUaJ03k4I='} 2023-08-30T14:43:41.382 INFO:teuthology.orchestra.console.smithi059:Power off 2023-08-30T14:43:41.383 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T14:43:41.402 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-08-30T14:43:41.403 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T14:43:41.423 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-08-30T14:43:41.524 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-08-30T14:43:41.679 INFO:teuthology.lock.ops:unlocked: smithi059.front.sepia.ceph.com