2024-01-14T15:16:52.453 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-01-14T15:16:52.454 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:16:52.594 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fd13b3edf40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fd13c453c10>, signals=[15])
2024-01-14T15:16:52.594 INFO:teuthology.lock.ops:Start node 'smithi093.front.sepia.ceph.com' reimaging
2024-01-14T15:16:52.594 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T15:16:52.595 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2024-01-14T15:16:52.618 INFO:teuthology.lock.ops:Start node 'smithi141.front.sepia.ceph.com' reimaging
2024-01-14T15:16:52.618 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: reset os type and version on server
2024-01-14T15:16:52.618 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-14T15:16:52.730 DEBUG:teuthology.provision.fog.smithi093:Requesting image smithi_centos_9.stream (ID 10)
2024-01-14T15:16:52.757 DEBUG:teuthology.provision.fog.smithi141:Requesting image smithi_centos_9.stream (ID 10)
2024-01-14T15:16:52.776 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of centos 9.stream
2024-01-14T15:16:52.807 INFO:teuthology.provision.fog.smithi141:Scheduling deploy of centos 9.stream
2024-01-14T15:16:52.997 INFO:teuthology.orchestra.console.smithi093:Power off
2024-01-14T15:16:52.997 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T15:16:53.022 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2024-01-14T15:16:53.022 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:16:53.040 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-14T15:16:53.041 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T15:16:53.049 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2024-01-14T15:16:53.062 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-14T15:16:53.062 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:16:53.083 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-14T15:16:57.052 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:16:57.084 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:16:57.162 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2024-01-14T15:16:57.195 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-14T15:17:01.165 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:01.196 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:01.274 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2024-01-14T15:17:01.305 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-14T15:17:05.276 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:05.306 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:05.385 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-14T15:17:05.414 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-14T15:17:05.487 INFO:teuthology.orchestra.console.smithi093:Power off completed
2024-01-14T15:17:05.514 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-14T15:17:05.588 INFO:teuthology.orchestra.console.smithi093:Power on
2024-01-14T15:17:05.588 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T15:17:05.609 DEBUG:teuthology.orchestra.console.smithi093:power on output: Chassis Power Control: Up/On
2024-01-14T15:17:05.609 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:05.616 INFO:teuthology.orchestra.console.smithi141:Power on
2024-01-14T15:17:05.616 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-01-14T15:17:05.630 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-14T15:17:05.636 DEBUG:teuthology.orchestra.console.smithi141:power on output: Chassis Power Control: Up/On
2024-01-14T15:17:05.636 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:05.657 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-14T15:17:09.632 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:09.658 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:17:09.741 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on
2024-01-14T15:17:09.767 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is on
2024-01-14T15:17:09.842 INFO:teuthology.orchestra.console.smithi093:Power on completed
2024-01-14T15:17:09.867 INFO:teuthology.orchestra.console.smithi141:Power on completed
2024-01-14T15:17:09.943 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish
2024-01-14T15:17:09.968 INFO:teuthology.provision.fog.smithi141:Waiting for deploy to finish
2024-01-14T15:19:40.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:19:55.875 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:19:59.296 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:05.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:08.380 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:14.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:14.396 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-14T15:20:17.440 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:20.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:23.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:23.452 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-14T15:20:26.528 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:29.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:32.508 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-14T15:20:32.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:35.580 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:38.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:41.564 WARNING:teuthology.provision.fog.smithi141:[Errno None] Unable to connect to port 22 on 172.21.15.141
2024-01-14T15:20:41.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:44.636 WARNING:teuthology.provision.fog.smithi093:[Errno None] Unable to connect to port 22 on 172.21.15.93
2024-01-14T15:20:47.566 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:20:50.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:21:47.620 WARNING:teuthology.provision.fog.smithi141:timed out
2024-01-14T15:21:50.644 WARNING:teuthology.provision.fog.smithi093:timed out
2024-01-14T15:21:53.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:21:53.845 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T15:21:53.846 DEBUG:teuthology.orchestra.run.smithi141:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T15:21:54.206 INFO:teuthology.provision.fog.smithi141:Node is ready
2024-01-14T15:21:54.206 DEBUG:teuthology.orchestra.run.smithi141:> hostname
2024-01-14T15:21:54.222 INFO:teuthology.orchestra.run.smithi141.stdout:smithi141.front.sepia.ceph.com
2024-01-14T15:21:54.222 DEBUG:teuthology.orchestra.run.smithi141:> grep smithi141.front.sepia.ceph.com /etc/hosts
2024-01-14T15:21:54.278 INFO:teuthology.orchestra.run.smithi141.stdout:172.21.15.141 smithi141.front.sepia.ceph.com smithi141
2024-01-14T15:21:54.279 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-14T15:21:54.391 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hosts
2024-01-14T15:21:54.421 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/172.21.15.141/172.21.15.141/g' /etc/hosts
2024-01-14T15:21:54.489 DEBUG:teuthology.orchestra.run.smithi141:> sudo sed -i -e 's/smithi141.front.sepia.ceph.com/smithi141/g' /etc/hostname
2024-01-14T15:21:54.557 DEBUG:teuthology.orchestra.run.smithi141:> sudo hostname smithi141
2024-01-14T15:21:54.625 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-14T15:21:54.679 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2024-01-14T15:21:54.679 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9"
2024-01-14T15:21:54.679 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2024-01-14T15:21:54.679 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-14T15:21:54.680 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-14T15:21:54.681 INFO:teuthology.provision.fog.smithi141:Deploy complete!
2024-01-14T15:21:54.682 DEBUG:teuthology.parallel:result is None
2024-01-14T15:21:56.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:21:56.856 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-01-14T15:21:56.856 DEBUG:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-01-14T15:21:57.167 INFO:teuthology.provision.fog.smithi093:Node is ready
2024-01-14T15:21:57.167 DEBUG:teuthology.orchestra.run.smithi093:> hostname
2024-01-14T15:21:57.182 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com
2024-01-14T15:21:57.182 DEBUG:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts
2024-01-14T15:21:57.235 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093
2024-01-14T15:21:57.236 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2024-01-14T15:21:57.335 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts
2024-01-14T15:21:57.364 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts
2024-01-14T15:21:57.432 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname
2024-01-14T15:21:57.499 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname smithi093
2024-01-14T15:21:57.564 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2024-01-14T15:21:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2024-01-14T15:21:57.616 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-14T15:21:57.617 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-14T15:21:57.618 INFO:teuthology.provision.fog.smithi093:Deploy complete!
2024-01-14T15:21:57.618 DEBUG:teuthology.parallel:result is None
2024-01-14T15:21:57.796 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com
2024-01-14T15:21:57.796 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-14T15:21:57.821 INFO:teuthology.lock.ops:Checking smithi141.front.sepia.ceph.com
2024-01-14T15:21:57.821 INFO:teuthology.lock.ops:New key found. Updating...
2024-01-14T15:21:57.839 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server
2024-01-14T15:21:57.839 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com'
2024-01-14T15:21:57.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:21:57.924 DEBUG:teuthology.orchestra.run.smithi093:> true
2024-01-14T15:21:57.990 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com'
2024-01-14T15:21:57.991 DEBUG:teuthology.orchestra.run.smithi093:> uname -m
2024-01-14T15:21:58.043 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64
2024-01-14T15:21:58.043 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release
2024-01-14T15:21:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="CentOS Stream"
2024-01-14T15:21:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="9"
2024-01-14T15:21:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ID="centos"
2024-01-14T15:21:58.095 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="rhel fedora"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="9"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el9"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:LOGO="fedora-logo-icon"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://centos.org/"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-14T15:21:58.096 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-14T15:21:58.097 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server
2024-01-14T15:21:58.121 INFO:teuthology.lock.ops:Updating [smithi141.front.sepia.ceph.com]: set os type and version on server
2024-01-14T15:21:58.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-14T15:21:58.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi141.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-01-14T15:21:58.213 DEBUG:teuthology.orchestra.run.smithi141:> true
2024-01-14T15:21:58.285 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi141.front.sepia.ceph.com'
2024-01-14T15:21:58.285 DEBUG:teuthology.orchestra.run.smithi141:> uname -m
2024-01-14T15:21:58.342 INFO:teuthology.orchestra.run.smithi141.stdout:x86_64
2024-01-14T15:21:58.343 DEBUG:teuthology.orchestra.run.smithi141:> cat /etc/os-release
2024-01-14T15:21:58.399 INFO:teuthology.orchestra.run.smithi141.stdout:NAME="CentOS Stream"
2024-01-14T15:21:58.399 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION="9"
2024-01-14T15:21:58.399 INFO:teuthology.orchestra.run.smithi141.stdout:ID="centos"
2024-01-14T15:21:58.399 INFO:teuthology.orchestra.run.smithi141.stdout:ID_LIKE="rhel fedora"
2024-01-14T15:21:58.399 INFO:teuthology.orchestra.run.smithi141.stdout:VERSION_ID="9"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:PLATFORM_ID="platform:el9"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:PRETTY_NAME="CentOS Stream 9"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:ANSI_COLOR="0;31"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:LOGO="fedora-logo-icon"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:HOME_URL="https://centos.org/"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-01-14T15:21:58.400 INFO:teuthology.orchestra.run.smithi141.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-01-14T15:21:58.401 INFO:teuthology.lock.ops:Updating smithi141.front.sepia.ceph.com on lock server
2024-01-14T15:21:58.421 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:21:58.513 INFO:teuthology.dispatcher.supervisor:Running job 7516581
2024-01-14T15:21:58.513 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_dis@teuthology --archive /home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516581 --name dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi --description rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_latest} workloads/rbd-mirror-snapshot-workunit-minimum} -- /home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516581/orig.config.yaml
2024-01-14T15:21:58.516 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516581
2024-01-14T15:21:58.516 INFO:teuthology.dispatcher.supervisor:Job PID: 3899167
2024-01-14T15:21:58.517 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-01-14T15:23:58.609 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:25:58.776 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:27:58.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:29:59.101 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:31:59.268 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:33:59.426 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:35:59.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:37:59.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:39:59.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:42:00.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:44:00.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:46:00.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:48:00.642 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:50:00.832 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:52:00.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-01-14T15:52:01.053 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-01-14T15:52:01.160 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2024-01-14T15:52:01.160 INFO:teuthology.nuke:Checking targets against current locks
2024-01-14T15:52:01.207 DEBUG:teuthology.nuke:shortname: smithi093
2024-01-14T15:52:01.208 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T15:52:01.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 15:16:51.439439', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/T7OZOmMbicxo0JNiMJ0w2wPzGn5wuf64fINV/NrxAYVDXYxUygQJZiWZn71PrsmRrN7OoeC/OKuw1IzPkb8s='}
2024-01-14T15:52:01.233 DEBUG:teuthology.nuke:shortname: smithi141
2024-01-14T15:52:01.234 INFO:teuthology.task.internal.check_lock:Checking locks...
2024-01-14T15:52:01.253 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi141.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dis-2024-01-14_14:02:30-rbd-wip-dis-testing-1-distro-default-smithi/7516581', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-14 15:16:51.437548', 'locked_by': 'scheduled_dis@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKwdIWOEAVfryLD+z2FgCVwlNPP0TjVHOzBBsp2a40oU2FvsiCGRz14bbmsM4DmIiAOgeZiImnSEQS0zal53O9w='}
2024-01-14T15:52:01.284 INFO:teuthology.orchestra.console.smithi093:Power off
2024-01-14T15:52:01.284 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T15:52:01.305 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off
2024-01-14T15:52:01.305 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:52:01.319 INFO:teuthology.orchestra.console.smithi141:Power off
2024-01-14T15:52:01.319 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-01-14T15:52:01.327 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off
2024-01-14T15:52:01.339 DEBUG:teuthology.orchestra.console.smithi141:power off output: Chassis Power Control: Down/Off
2024-01-14T15:52:01.339 DEBUG:teuthology.orchestra.console.smithi141:pexpect command: ipmitool -H smithi141.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-01-14T15:52:01.364 DEBUG:teuthology.orchestra.console.smithi141:check power output: Chassis Power is off
2024-01-14T15:52:01.428 INFO:teuthology.orchestra.console.smithi093:Power off completed
2024-01-14T15:52:01.465 INFO:teuthology.orchestra.console.smithi141:Power off completed
2024-01-14T15:52:01.575 INFO:teuthology.lock.ops:unlocked: smithi093.front.sepia.ceph.com
2024-01-14T15:52:01.617 INFO:teuthology.lock.ops:unlocked: smithi141.front.sepia.ceph.com