2023-12-08T07:56:13.064 INFO:root:teuthology version: 0.0.1.dev214+gf2de108
2023-12-08T07:56:13.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T07:56:13.209 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f77550b8400>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f7755fde550>, signals=[15])
2023-12-08T07:56:13.210 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging
2023-12-08T07:56:13.211 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server
2023-12-08T07:56:13.211 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-08T07:56:13.240 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging
2023-12-08T07:56:13.240 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server
2023-12-08T07:56:13.240 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-12-08T07:56:13.358 DEBUG:teuthology.provision.fog.smithi124:Requesting image smithi_centos_8.stream (ID 3)
2023-12-08T07:56:13.382 DEBUG:teuthology.provision.fog.smithi176:Requesting image smithi_centos_8.stream (ID 3)
2023-12-08T07:56:13.397 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream
2023-12-08T07:56:13.430 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of centos 8.stream
2023-12-08T07:56:13.620 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-08T07:56:13.620 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T07:56:13.642 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-08T07:56:13.643 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:13.655 INFO:teuthology.orchestra.console.smithi176:Power off
2023-12-08T07:56:13.656 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T07:56:13.664 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-08T07:56:13.678 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2023-12-08T07:56:13.678 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:13.704 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2023-12-08T07:56:17.668 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:17.705 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:17.777 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-08T07:56:17.814 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2023-12-08T07:56:21.782 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:21.816 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:21.891 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-08T07:56:21.925 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-12-08T07:56:22.027 INFO:teuthology.orchestra.console.smithi176:Power off completed
2023-12-08T07:56:22.128 INFO:teuthology.orchestra.console.smithi176:Power on
2023-12-08T07:56:22.128 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-08T07:56:22.148 DEBUG:teuthology.orchestra.console.smithi176:power on output: Chassis Power Control: Up/On
2023-12-08T07:56:22.149 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:22.170 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-12-08T07:56:25.896 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:26.007 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-08T07:56:26.107 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-08T07:56:26.171 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:26.208 INFO:teuthology.orchestra.console.smithi124:Power on
2023-12-08T07:56:26.208 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-12-08T07:56:26.229 DEBUG:teuthology.orchestra.console.smithi124:power on output: Chassis Power Control: Up/On
2023-12-08T07:56:26.230 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:26.251 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-08T07:56:26.280 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-12-08T07:56:30.254 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:30.281 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T07:56:30.363 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is on
2023-12-08T07:56:30.429 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on
2023-12-08T07:56:30.464 INFO:teuthology.orchestra.console.smithi124:Power on completed
2023-12-08T07:56:30.530 INFO:teuthology.orchestra.console.smithi176:Power on completed
2023-12-08T07:56:30.566 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish
2023-12-08T07:56:30.631 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish
2023-12-08T07:59:01.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:04.514 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:10.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:13.570 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:16.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:19.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:19.590 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T07:59:22.626 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:25.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:28.630 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:28.674 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T07:59:31.682 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:34.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:37.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:37.734 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T07:59:40.738 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:43.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:46.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:46.822 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T07:59:49.794 WARNING:teuthology.provision.fog.smithi176:[Errno None] Unable to connect to port 22 on 172.21.15.176
2023-12-08T07:59:52.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:55.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T07:59:55.906 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T08:00:01.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:00:04.966 WARNING:teuthology.provision.fog.smithi124:[Errno None] Unable to connect to port 22 on 172.21.15.124
2023-12-08T08:00:10.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:00:55.847 WARNING:teuthology.provision.fog.smithi176:timed out
2023-12-08T08:01:01.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:01:02.075 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-08T08:01:02.076 DEBUG:teuthology.orchestra.run.smithi176:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-08T08:01:02.412 INFO:teuthology.provision.fog.smithi176:Node is ready
2023-12-08T08:01:02.412 DEBUG:teuthology.orchestra.run.smithi176:> hostname
2023-12-08T08:01:02.432 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com
2023-12-08T08:01:02.432 DEBUG:teuthology.orchestra.run.smithi176:> grep smithi176.front.sepia.ceph.com /etc/hosts
2023-12-08T08:01:02.491 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176
2023-12-08T08:01:02.491 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2023-12-08T08:01:02.592 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hosts
2023-12-08T08:01:02.622 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/172.21.15.176/172.21.15.176/g' /etc/hosts
2023-12-08T08:01:02.690 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i -e 's/smithi176.front.sepia.ceph.com/smithi176/g' /etc/hostname
2023-12-08T08:01:02.757 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname smithi176
2023-12-08T08:01:02.824 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2023-12-08T08:01:02.882 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2023-12-08T08:01:02.882 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2023-12-08T08:01:02.882 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-08T08:01:02.883 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T08:01:02.884 INFO:teuthology.provision.fog.smithi176:Deploy complete!
2023-12-08T08:01:02.885 DEBUG:teuthology.parallel:result is None
2023-12-08T08:01:10.978 WARNING:teuthology.provision.fog.smithi124:timed out
2023-12-08T08:01:16.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:01:17.226 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-12-08T08:01:17.226 DEBUG:teuthology.orchestra.run.smithi124:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-12-08T08:01:17.474 INFO:teuthology.provision.fog.smithi124:Node is ready
2023-12-08T08:01:17.475 DEBUG:teuthology.orchestra.run.smithi124:> hostname
2023-12-08T08:01:17.496 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com
2023-12-08T08:01:17.496 DEBUG:teuthology.orchestra.run.smithi124:> grep smithi124.front.sepia.ceph.com /etc/hosts
2023-12-08T08:01:17.557 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124
2023-12-08T08:01:17.558 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-08T08:01:17.657 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hosts
2023-12-08T08:01:17.692 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/172.21.15.124/172.21.15.124/g' /etc/hosts
2023-12-08T08:01:17.765 DEBUG:teuthology.orchestra.run.smithi124:> sudo sed -i -e 's/smithi124.front.sepia.ceph.com/smithi124/g' /etc/hostname
2023-12-08T08:01:17.840 DEBUG:teuthology.orchestra.run.smithi124:> sudo hostname smithi124
2023-12-08T08:01:17.914 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-08T08:01:17.977 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-08T08:01:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-08T08:01:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-08T08:01:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T08:01:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-08T08:01:17.978 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T08:01:17.978 INFO:teuthology.provision.fog.smithi124:Deploy complete!
2023-12-08T08:01:17.979 DEBUG:teuthology.parallel:result is None
2023-12-08T08:01:18.129 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com
2023-12-08T08:01:18.130 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-08T08:01:18.161 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com
2023-12-08T08:01:18.161 INFO:teuthology.lock.ops:New key found. Updating...
2023-12-08T08:01:18.187 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server
2023-12-08T08:01:18.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-08T08:01:18.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi124.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:01:18.257 DEBUG:teuthology.orchestra.run.smithi124:> true
2023-12-08T08:01:18.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi124.front.sepia.ceph.com'
2023-12-08T08:01:18.328 DEBUG:teuthology.orchestra.run.smithi124:> uname -m
2023-12-08T08:01:18.389 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64
2023-12-08T08:01:18.390 DEBUG:teuthology.orchestra.run.smithi124:> cat /etc/os-release
2023-12-08T08:01:18.452 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream"
2023-12-08T08:01:18.452 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8"
2023-12-08T08:01:18.452 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31"
2023-12-08T08:01:18.453 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-08T08:01:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/"
2023-12-08T08:01:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T08:01:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-08T08:01:18.454 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T08:01:18.455 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server
2023-12-08T08:01:18.478 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server
2023-12-08T08:01:18.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-12-08T08:01:18.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-12-08T08:01:18.547 DEBUG:teuthology.orchestra.run.smithi176:> true
2023-12-08T08:01:18.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com'
2023-12-08T08:01:18.686 DEBUG:teuthology.orchestra.run.smithi176:> uname -m
2023-12-08T08:01:18.745 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64
2023-12-08T08:01:18.745 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 8"
2023-12-08T08:01:18.805 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31"
2023-12-08T08:01:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-12-08T08:01:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/"
2023-12-08T08:01:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-12-08T08:01:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-12-08T08:01:18.806 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-12-08T08:01:18.807 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server
2023-12-08T08:01:18.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:01:18.926 INFO:teuthology.dispatcher.supervisor:Running job 7483773
2023-12-08T08:01:18.926 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483773 --name vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483773/orig.config.yaml
2023-12-08T08:01:18.929 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483773
2023-12-08T08:01:18.930 INFO:teuthology.dispatcher.supervisor:Job PID: 3054773
2023-12-08T08:01:18.930 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-12-08T08:03:19.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:05:19.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:07:19.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:09:19.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:11:19.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:13:19.878 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:15:20.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:17:20.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:19:20.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:21:20.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:23:20.688 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:25:20.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:27:21.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:29:21.196 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:31:21.361 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:33:21.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:35:21.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:37:21.859 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:39:22.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:41:22.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:43:22.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:45:22.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:47:22.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:49:22.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:51:23.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:53:23.195 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:55:23.368 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:57:23.539 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T08:59:23.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:01:23.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:03:24.036 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:05:24.207 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:07:24.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:09:24.563 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:11:24.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:13:24.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:15:25.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:17:25.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:19:25.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-12-08T09:19:25.468 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-12-08T09:19:25.671 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-12-08T09:19:25.671 INFO:teuthology.nuke:Checking targets against current locks
2023-12-08T09:19:25.725 DEBUG:teuthology.nuke:shortname: smithi124
2023-12-08T09:19:25.726 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-08T09:19:25.746 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi124.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483773', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:56:12.210113', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC0SzZFLQa6zFgyYj4JeGQj3b4sLoUl9gWUEkOqpUZRPmERX8owxgIaeSyJmBGPQ8LYCEZUjPcNPTf4iqmStt/4='}
2023-12-08T09:19:25.749 DEBUG:teuthology.nuke:shortname: smithi176
2023-12-08T09:19:25.749 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-12-08T09:19:25.771 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-08_07:46:48-fs-wip-vshankar-testing-20231206.125818-distro-default-smithi/7483773', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-08 07:56:12.208480', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOs10wwxTAfuXqKINxAsFQ5yixG6ixu7aGjnpjUKzo8NsP+gx/hc8cGi/m7AxYntTGiSI6T0Kl9qxHn1ZDMjGc0='}
2023-12-08T09:19:25.798 INFO:teuthology.orchestra.console.smithi124:Power off
2023-12-08T09:19:25.799 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T09:19:25.827 DEBUG:teuthology.orchestra.console.smithi124:power off output: Chassis Power Control: Down/Off
2023-12-08T09:19:25.828 DEBUG:teuthology.orchestra.console.smithi124:pexpect command: ipmitool -H smithi124.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T09:19:25.843 INFO:teuthology.orchestra.console.smithi176:Power off
2023-12-08T09:19:25.844 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-12-08T09:19:25.854 DEBUG:teuthology.orchestra.console.smithi124:check power output: Chassis Power is off
2023-12-08T09:19:25.865 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off
2023-12-08T09:19:25.865 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-12-08T09:19:25.889 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off
2023-12-08T09:19:25.955 INFO:teuthology.orchestra.console.smithi124:Power off completed
2023-12-08T09:19:25.990 INFO:teuthology.orchestra.console.smithi176:Power off completed
2023-12-08T09:19:26.108 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com
2023-12-08T09:19:26.141 INFO:teuthology.lock.ops:unlocked: smithi176.front.sepia.ceph.com