2023-11-29T23:03:52.901 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-11-29T23:03:52.902 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:03:53.043 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7feb110a3df0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7feb1217b550>, signals=[15])
2023-11-29T23:03:53.043 INFO:teuthology.lock.ops:Start node 'smithi038.front.sepia.ceph.com' reimaging
2023-11-29T23:03:53.043 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: reset os type and version on server
2023-11-29T23:03:53.043 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-11-29T23:03:53.064 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging
2023-11-29T23:03:53.064 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server
2023-11-29T23:03:53.064 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-11-29T23:03:53.167 DEBUG:teuthology.provision.fog.smithi038:Requesting image smithi_centos_8.stream (ID 3)
2023-11-29T23:03:53.180 DEBUG:teuthology.provision.fog.smithi132:Requesting image smithi_centos_8.stream (ID 3)
2023-11-29T23:03:53.205 INFO:teuthology.provision.fog.smithi038:Scheduling deploy of centos 8.stream
2023-11-29T23:03:53.217 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of centos 8.stream
2023-11-29T23:03:53.451 INFO:teuthology.orchestra.console.smithi038:Power off
2023-11-29T23:03:53.452 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T23:03:53.466 INFO:teuthology.orchestra.console.smithi132:Power off
2023-11-29T23:03:53.466 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T23:03:53.475 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off
2023-11-29T23:03:53.475 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:53.488 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-11-29T23:03:53.489 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:53.498 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-29T23:03:53.513 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-11-29T23:03:53.599 INFO:teuthology.orchestra.console.smithi038:Power off completed
2023-11-29T23:03:53.614 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-11-29T23:03:53.700 INFO:teuthology.orchestra.console.smithi038:Power on
2023-11-29T23:03:53.700 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-29T23:03:53.715 INFO:teuthology.orchestra.console.smithi132:Power on
2023-11-29T23:03:53.716 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-29T23:03:53.725 DEBUG:teuthology.orchestra.console.smithi038:power on output: Chassis Power Control: Up/On
2023-11-29T23:03:53.725 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:53.738 DEBUG:teuthology.orchestra.console.smithi132:power on output: Chassis Power Control: Up/On
2023-11-29T23:03:53.739 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:53.749 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-29T23:03:53.763 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-11-29T23:03:57.754 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:57.764 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:03:57.864 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is on
2023-11-29T23:03:57.873 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on
2023-11-29T23:03:57.965 INFO:teuthology.orchestra.console.smithi038:Power on completed
2023-11-29T23:03:57.974 INFO:teuthology.orchestra.console.smithi132:Power on completed
2023-11-29T23:03:58.067 INFO:teuthology.provision.fog.smithi038:Waiting for deploy to finish
2023-11-29T23:03:58.075 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish
2023-11-29T23:06:28.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:06:28.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:06:28.957 ERROR:teuthology.orchestra.connection:Error authenticating with smithi038.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-29T23:06:29.343 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-29T23:07:32.961 WARNING:teuthology.provision.fog.smithi038:timed out
2023-11-29T23:07:33.346 WARNING:teuthology.provision.fog.smithi132:timed out
2023-11-29T23:07:38.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:07:39.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:07:42.018 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-29T23:07:48.020 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:07:51.074 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-29T23:07:57.075 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:07:57.666 WARNING:teuthology.provision.fog.smithi132:[Errno None] Unable to connect to port 22 on 172.21.15.132
2023-11-29T23:08:00.134 WARNING:teuthology.provision.fog.smithi038:[Errno None] Unable to connect to port 22 on 172.21.15.38
2023-11-29T23:08:03.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:08:03.852 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-29T23:08:03.868 DEBUG:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-29T23:08:06.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:08:06.358 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-29T23:08:06.358 DEBUG:teuthology.orchestra.run.smithi038:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-29T23:08:21.599 INFO:teuthology.provision.fog.smithi038:Node is ready
2023-11-29T23:08:21.600 DEBUG:teuthology.orchestra.run.smithi038:> hostname
2023-11-29T23:08:21.625 INFO:teuthology.orchestra.run.smithi038.stdout:smithi193
2023-11-29T23:08:21.625 DEBUG:teuthology.orchestra.run.smithi038:> grep smithi193 /etc/hosts
2023-11-29T23:08:21.687 INFO:teuthology.orchestra.run.smithi038.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-11-29T23:08:21.688 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-11-29T23:08:21.889 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi193/smithi038/g' /etc/hosts
2023-11-29T23:08:21.924 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/172.21.15.193/172.21.15.38/g' /etc/hosts
2023-11-29T23:08:21.996 DEBUG:teuthology.orchestra.run.smithi038:> sudo sed -i -e 's/smithi193/smithi038/g' /etc/hostname
2023-11-29T23:08:22.067 DEBUG:teuthology.orchestra.run.smithi038:> sudo hostname smithi038
2023-11-29T23:08:22.137 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-29T23:08:22.196 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-11-29T23:08:22.197 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-29T23:08:22.197 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-11-29T23:08:22.197 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T23:08:22.197 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T23:08:22.197 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-29T23:08:22.198 INFO:teuthology.provision.fog.smithi038:Deploy complete!
2023-11-29T23:08:22.198 DEBUG:teuthology.parallel:result is None
2023-11-29T23:08:23.876 INFO:teuthology.provision.fog.smithi132:Node is ready
2023-11-29T23:08:23.877 DEBUG:teuthology.orchestra.run.smithi132:> hostname
2023-11-29T23:08:23.901 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com
2023-11-29T23:08:23.901 DEBUG:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts
2023-11-29T23:08:23.962 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132
2023-11-29T23:08:23.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-11-29T23:08:24.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts
2023-11-29T23:08:24.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts
2023-11-29T23:08:24.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname
2023-11-29T23:08:24.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo hostname smithi132
2023-11-29T23:08:24.313 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-11-29T23:08:24.371 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2023-11-29T23:08:24.371 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2023-11-29T23:08:24.371 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T23:08:24.372 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-29T23:08:24.372 INFO:teuthology.provision.fog.smithi132:Deploy complete!
2023-11-29T23:08:24.373 DEBUG:teuthology.parallel:result is None
2023-11-29T23:08:24.528 INFO:teuthology.lock.ops:Checking smithi038.front.sepia.ceph.com
2023-11-29T23:08:24.529 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-29T23:08:24.554 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com
2023-11-29T23:08:24.554 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-29T23:08:24.572 INFO:teuthology.lock.ops:Updating [smithi038.front.sepia.ceph.com]: set os type and version on server
2023-11-29T23:08:24.572 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-11-29T23:08:24.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi038.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:08:24.646 DEBUG:teuthology.orchestra.run.smithi038:> true
2023-11-29T23:08:24.721 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi038.front.sepia.ceph.com'
2023-11-29T23:08:24.721 DEBUG:teuthology.orchestra.run.smithi038:> uname -m
2023-11-29T23:08:24.783 INFO:teuthology.orchestra.run.smithi038.stdout:x86_64
2023-11-29T23:08:24.784 DEBUG:teuthology.orchestra.run.smithi038:> cat /etc/os-release
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:NAME="CentOS Stream"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION="8"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:ID="centos"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:ID_LIKE="rhel fedora"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:VERSION_ID="8"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:PLATFORM_ID="platform:el8"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:ANSI_COLOR="0;31"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:HOME_URL="https://centos.org/"
2023-11-29T23:08:24.846 INFO:teuthology.orchestra.run.smithi038.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T23:08:24.847 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T23:08:24.847 INFO:teuthology.orchestra.run.smithi038.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-29T23:08:24.847 INFO:teuthology.lock.ops:Updating smithi038.front.sepia.ceph.com on lock server
2023-11-29T23:08:24.872 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server
2023-11-29T23:08:24.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-11-29T23:08:24.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-29T23:08:24.940 DEBUG:teuthology.orchestra.run.smithi132:> true
2023-11-29T23:08:25.012 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com'
2023-11-29T23:08:25.012 DEBUG:teuthology.orchestra.run.smithi132:> uname -m
2023-11-29T23:08:25.072 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64
2023-11-29T23:08:25.072 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release
2023-11-29T23:08:25.130 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-29T23:08:25.131 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/"
2023-11-29T23:08:25.132 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-29T23:08:25.132 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-29T23:08:25.132 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-29T23:08:25.132 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server
2023-11-29T23:08:25.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:08:25.320 INFO:teuthology.dispatcher.supervisor:Running job 7471189
2023-11-29T23:08:25.321 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471189 --name yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} -- /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471189/orig.config.yaml
2023-11-29T23:08:25.324 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471189
2023-11-29T23:08:25.324 INFO:teuthology.dispatcher.supervisor:Job PID: 808240
2023-11-29T23:08:25.324 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-29T23:10:25.325 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:12:25.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:14:25.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:16:25.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:18:25.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:20:25.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:22:25.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:24:25.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:26:25.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:28:25.918 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:30:25.984 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:32:26.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:34:26.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:36:26.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:38:26.272 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:40:26.334 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:42:26.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:44:26.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:46:26.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:48:26.614 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:50:26.696 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:52:26.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:54:26.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:56:26.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:58:26.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-29T23:58:27.016 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-29T23:58:27.150 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-29T23:58:27.150 INFO:teuthology.nuke:Checking targets against current locks
2023-11-29T23:58:27.200 DEBUG:teuthology.nuke:shortname: smithi038
2023-11-29T23:58:27.200 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-29T23:58:27.219 DEBUG:teuthology.nuke:shortname: smithi132
2023-11-29T23:58:27.220 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-29T23:58:27.223 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi038.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 23:03:52.080902', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK+zGx5lJcbi5ccqGY+b2ZaKQZhlkbG63zfxfzTZJXVSXxIqJJVAM+8+dTl/vLRFwP88u8Mqo29foQAtVQL0D1E='}
2023-11-29T23:58:27.241 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-29_18:10:24-rados-wip-yuri-testing-2023-11-27-1028-pacific-distro-default-smithi/7471189', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-29 23:03:52.082363', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHZbRxDgTpjpG04b08H3qMlGT8n62XgcutpPCJUKDmM6ygmviTDHWcAvIrDyk8V3Zi5b91E0XeMDP6whbaGyaIA='}
2023-11-29T23:58:27.265 INFO:teuthology.orchestra.console.smithi038:Power off
2023-11-29T23:58:27.265 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T23:58:27.288 DEBUG:teuthology.orchestra.console.smithi038:power off output: Chassis Power Control: Down/Off
2023-11-29T23:58:27.289 DEBUG:teuthology.orchestra.console.smithi038:pexpect command: ipmitool -H smithi038.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:58:27.302 INFO:teuthology.orchestra.console.smithi132:Power off
2023-11-29T23:58:27.302 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-29T23:58:27.311 DEBUG:teuthology.orchestra.console.smithi038:check power output: Chassis Power is off
2023-11-29T23:58:27.323 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off
2023-11-29T23:58:27.323 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-29T23:58:27.344 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off
2023-11-29T23:58:27.412 INFO:teuthology.orchestra.console.smithi038:Power off completed
2023-11-29T23:58:27.444 INFO:teuthology.orchestra.console.smithi132:Power off completed
2023-11-29T23:58:27.564 INFO:teuthology.lock.ops:unlocked: smithi038.front.sepia.ceph.com
2023-11-29T23:58:27.590 INFO:teuthology.lock.ops:unlocked: smithi132.front.sepia.ceph.com