2023-11-23T02:50:20.166 INFO:root:teuthology version: 0.0.1.dev205+g2442239
2023-11-23T02:50:20.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:50:20.362 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9ba6d60940>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9ba6a5eee0>, signals=[15])
2023-11-23T02:50:20.363 INFO:teuthology.lock.ops:Start node 'smithi057.front.sepia.ceph.com' reimaging
2023-11-23T02:50:20.363 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:50:20.363 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-11-23T02:50:20.383 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging
2023-11-23T02:50:20.384 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server
2023-11-23T02:50:20.384 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-11-23T02:50:20.501 DEBUG:teuthology.provision.fog.smithi057:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:50:20.515 DEBUG:teuthology.provision.fog.smithi129:Requesting image smithi_centos_8.stream (ID 3)
2023-11-23T02:50:20.548 INFO:teuthology.provision.fog.smithi057:Scheduling deploy of centos 8.stream
2023-11-23T02:50:20.556 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream
2023-11-23T02:50:20.773 INFO:teuthology.orchestra.console.smithi057:Power off
2023-11-23T02:50:20.773 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:50:20.785 INFO:teuthology.orchestra.console.smithi129:Power off
2023-11-23T02:50:20.785 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T02:50:20.794 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-11-23T02:50:20.795 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:20.806 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off
2023-11-23T02:50:20.806 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:20.814 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-23T02:50:20.827 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-11-23T02:50:20.915 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-11-23T02:50:20.928 INFO:teuthology.orchestra.console.smithi129:Power off completed
2023-11-23T02:50:21.016 INFO:teuthology.orchestra.console.smithi057:Power on
2023-11-23T02:50:21.016 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:50:21.029 INFO:teuthology.orchestra.console.smithi129:Power on
2023-11-23T02:50:21.029 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-23T02:50:21.036 DEBUG:teuthology.orchestra.console.smithi057:power on output: Chassis Power Control: Up/On
2023-11-23T02:50:21.037 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:21.050 DEBUG:teuthology.orchestra.console.smithi129:power on output: Chassis Power Control: Up/On
2023-11-23T02:50:21.050 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:21.058 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-23T02:50:21.070 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-11-23T02:50:25.062 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:25.071 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T02:50:25.171 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on
2023-11-23T02:50:25.178 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is on
2023-11-23T02:50:25.272 INFO:teuthology.orchestra.console.smithi057:Power on completed
2023-11-23T02:50:25.279 INFO:teuthology.orchestra.console.smithi129:Power on completed
2023-11-23T02:50:25.373 INFO:teuthology.provision.fog.smithi057:Waiting for deploy to finish
2023-11-23T02:50:25.379 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish
2023-11-23T02:53:11.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:11.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:14.434 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:14.434 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:53:20.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:20.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:23.490 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:23.490 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:53:29.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:29.498 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:32.578 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:32.578 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:53:38.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:38.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:41.638 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:41.639 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:53:47.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:47.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:50.722 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:50.723 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:53:56.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:56.730 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:53:59.810 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:53:59.810 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:54:05.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:05.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:08.866 WARNING:teuthology.provision.fog.smithi057:[Errno None] Unable to connect to port 22 on 172.21.15.57
2023-11-23T02:54:08.866 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:54:14.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:14.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:33.314 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:54:39.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:42.370 WARNING:teuthology.provision.fog.smithi129:[Errno None] Unable to connect to port 22 on 172.21.15.129
2023-11-23T02:54:48.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:54:49.181 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:54:49.181 DEBUG:teuthology.orchestra.run.smithi129:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:55:14.157 INFO:teuthology.provision.fog.smithi129:Node is ready
2023-11-23T02:55:14.157 DEBUG:teuthology.orchestra.run.smithi129:> hostname
2023-11-23T02:55:14.181 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com
2023-11-23T02:55:14.182 DEBUG:teuthology.orchestra.run.smithi129:> grep smithi129.front.sepia.ceph.com /etc/hosts
2023-11-23T02:55:14.243 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129
2023-11-23T02:55:14.244 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2023-11-23T02:55:14.369 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hosts
2023-11-23T02:55:14.402 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/172.21.15.129/172.21.15.129/g' /etc/hosts
2023-11-23T02:55:14.473 DEBUG:teuthology.orchestra.run.smithi129:> sudo sed -i -e 's/smithi129.front.sepia.ceph.com/smithi129/g' /etc/hostname
2023-11-23T02:55:14.543 DEBUG:teuthology.orchestra.run.smithi129:> sudo hostname smithi129
2023-11-23T02:55:14.612 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:55:14.672 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:55:14.673 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:55:14.673 INFO:teuthology.provision.fog.smithi129:Deploy complete!
2023-11-23T02:55:14.675 DEBUG:teuthology.parallel:result is None
2023-11-23T02:55:14.873 WARNING:teuthology.provision.fog.smithi057:timed out
2023-11-23T02:55:20.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:55:21.141 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-23T02:55:21.142 DEBUG:teuthology.orchestra.run.smithi057:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-23T02:55:21.391 INFO:teuthology.provision.fog.smithi057:Node is ready
2023-11-23T02:55:21.391 DEBUG:teuthology.orchestra.run.smithi057:> hostname
2023-11-23T02:55:21.454 INFO:teuthology.orchestra.run.smithi057.stdout:smithi057.front.sepia.ceph.com
2023-11-23T02:55:21.454 DEBUG:teuthology.orchestra.run.smithi057:> grep smithi057.front.sepia.ceph.com /etc/hosts
2023-11-23T02:55:21.518 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.15.57 smithi057.front.sepia.ceph.com smithi057
2023-11-23T02:55:21.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-11-23T02:55:21.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hosts
2023-11-23T02:55:21.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/172.21.15.57/172.21.15.57/g' /etc/hosts
2023-11-23T02:55:21.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i -e 's/smithi057.front.sepia.ceph.com/smithi057/g' /etc/hostname
2023-11-23T02:55:21.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo hostname smithi057
2023-11-23T02:55:21.875 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-11-23T02:55:21.937 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:55:21.938 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:55:21.938 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:55:21.938 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:55:21.938 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:55:21.938 INFO:teuthology.provision.fog.smithi057:Deploy complete!
2023-11-23T02:55:21.938 DEBUG:teuthology.parallel:result is None
2023-11-23T02:55:22.085 INFO:teuthology.lock.ops:Checking smithi057.front.sepia.ceph.com
2023-11-23T02:55:22.085 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:55:22.107 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com
2023-11-23T02:55:22.107 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-23T02:55:22.124 INFO:teuthology.lock.ops:Updating [smithi057.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:55:22.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-11-23T02:55:22.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:55:22.196 DEBUG:teuthology.orchestra.run.smithi057:> true
2023-11-23T02:55:22.264 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com'
2023-11-23T02:55:22.264 DEBUG:teuthology.orchestra.run.smithi057:> uname -m
2023-11-23T02:55:22.326 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64
2023-11-23T02:55:22.327 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release
2023-11-23T02:55:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream"
2023-11-23T02:55:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8"
2023-11-23T02:55:22.388 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:55:22.389 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:55:22.390 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server
2023-11-23T02:55:22.407 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server
2023-11-23T02:55:22.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-11-23T02:55:22.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi129.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-23T02:55:22.476 DEBUG:teuthology.orchestra.run.smithi129:> true
2023-11-23T02:55:22.547 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi129.front.sepia.ceph.com'
2023-11-23T02:55:22.547 DEBUG:teuthology.orchestra.run.smithi129:> uname -m
2023-11-23T02:55:22.608 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64
2023-11-23T02:55:22.608 DEBUG:teuthology.orchestra.run.smithi129:> cat /etc/os-release
2023-11-23T02:55:22.668 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream"
2023-11-23T02:55:22.668 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8"
2023-11-23T02:55:22.668 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos"
2023-11-23T02:55:22.668 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora"
2023-11-23T02:55:22.668 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-23T02:55:22.669 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-23T02:55:22.669 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server
2023-11-23T02:55:22.690 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:55:22.785 INFO:teuthology.dispatcher.supervisor:Running job 7464551
2023-11-23T02:55:22.785 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464551 --name teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi --description upgrade:reef-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464551/orig.config.yaml
2023-11-23T02:55:22.788 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464551
2023-11-23T02:55:22.788 INFO:teuthology.dispatcher.supervisor:Job PID: 650593
2023-11-23T02:55:22.788 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-23T02:57:22.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T02:59:23.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:01:23.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:03:23.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:05:23.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:07:23.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:09:24.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:11:24.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:13:24.337 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:15:24.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:17:24.671 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:19:24.846 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:21:25.010 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:23:25.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:25:25.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:27:25.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:29:25.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:31:25.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:33:26.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:35:26.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:37:26.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:39:26.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:41:26.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:43:26.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:45:27.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:47:27.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:49:27.335 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:51:27.499 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:53:27.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:55:27.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:57:27.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T03:59:28.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:01:28.326 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:03:28.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:05:28.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:07:28.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:09:28.970 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:11:29.134 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:13:29.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:15:29.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:17:29.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:19:29.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:21:29.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:23:30.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:25:30.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:27:30.467 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:29:30.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-23T04:29:30.652 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-11-23T04:29:30.764 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-23T04:29:30.764 INFO:teuthology.nuke:Checking targets against current locks
2023-11-23T04:29:30.809 DEBUG:teuthology.nuke:shortname: smithi057
2023-11-23T04:29:30.810 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T04:29:30.832 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:50:19.381795', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJLjAXfWzbaAbH6YnLPSMhNQpF0ducbmJXjPydZJIcLxUWzfyyzJOo+SDGugwidkLRW150OYibuIttdV+PBkwqQ='}
2023-11-23T04:29:30.835 DEBUG:teuthology.nuke:shortname: smithi129
2023-11-23T04:29:30.835 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-23T04:29:30.857 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi129.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-11-23_02:25:02-upgrade:reef-x-main-distro-default-smithi/7464551', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-23 02:50:19.380280', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDeYkSgI1rU/2Q49JtNQuGtxuLd6CD2JPqz5vwO+k/7vXqG+2AoEl8mNYyhptUCb7C2lOy0KQfgOLLqxnpqphUA='}
2023-11-23T04:29:30.888 INFO:teuthology.orchestra.console.smithi057:Power off
2023-11-23T04:29:30.888 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T04:29:30.903 INFO:teuthology.orchestra.console.smithi129:Power off
2023-11-23T04:29:30.903 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-23T04:29:30.910 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off
2023-11-23T04:29:30.910 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T04:29:30.923 DEBUG:teuthology.orchestra.console.smithi129:power off output: Chassis Power Control: Down/Off
2023-11-23T04:29:30.923 DEBUG:teuthology.orchestra.console.smithi129:pexpect command: ipmitool -H smithi129.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-23T04:29:30.930 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off
2023-11-23T04:29:30.943 DEBUG:teuthology.orchestra.console.smithi129:check power output: Chassis Power is off
2023-11-23T04:29:31.031 INFO:teuthology.orchestra.console.smithi057:Power off completed
2023-11-23T04:29:31.044 INFO:teuthology.orchestra.console.smithi129:Power off completed
2023-11-23T04:29:31.185 INFO:teuthology.lock.ops:unlocked: smithi057.front.sepia.ceph.com
2023-11-23T04:29:31.194 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com