2024-01-21T20:25:18.537 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-21T20:25:18.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:25:18.681 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd3f49dec10>, signals=[15]) 2024-01-21T20:25:18.682 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging 2024-01-21T20:25:18.682 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T20:25:18.682 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-01-21T20:25:18.703 INFO:teuthology.lock.ops:Start node 'smithi076.front.sepia.ceph.com' reimaging 2024-01-21T20:25:18.703 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: reset os type and version on server 2024-01-21T20:25:18.704 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-21T20:25:18.820 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_8.stream (ID 3) 2024-01-21T20:25:18.828 DEBUG:teuthology.provision.fog.smithi076:Requesting image smithi_centos_8.stream (ID 3) 2024-01-21T20:25:18.861 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 8.stream 2024-01-21T20:25:18.868 INFO:teuthology.provision.fog.smithi076:Scheduling deploy of centos 8.stream 2024-01-21T20:25:19.168 INFO:teuthology.orchestra.console.smithi076:Power off 2024-01-21T20:25:19.168 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T20:25:19.181 INFO:teuthology.orchestra.console.smithi017:Power off 2024-01-21T20:25:19.181 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T20:25:19.190 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-01-21T20:25:19.190 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:19.202 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-01-21T20:25:19.202 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:19.211 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-21T20:25:19.225 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-01-21T20:25:19.326 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-01-21T20:25:19.426 INFO:teuthology.orchestra.console.smithi017:Power on 2024-01-21T20:25:19.427 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T20:25:19.447 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On 2024-01-21T20:25:19.447 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:19.469 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-01-21T20:25:23.212 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:23.320 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-21T20:25:23.470 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:23.579 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-01-21T20:25:27.324 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:27.433 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-21T20:25:27.534 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-01-21T20:25:27.580 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:27.635 INFO:teuthology.orchestra.console.smithi076:Power on 2024-01-21T20:25:27.636 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-21T20:25:27.657 DEBUG:teuthology.orchestra.console.smithi076:power on output: Chassis Power Control: Up/On 2024-01-21T20:25:27.657 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:27.677 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-21T20:25:27.689 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-01-21T20:25:27.791 INFO:teuthology.orchestra.console.smithi017:Power on completed 2024-01-21T20:25:27.891 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish 2024-01-21T20:25:31.680 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:31.787 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-21T20:25:35.792 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:25:35.900 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is on 2024-01-21T20:25:36.000 INFO:teuthology.orchestra.console.smithi076:Power on completed 2024-01-21T20:25:36.101 INFO:teuthology.provision.fog.smithi076:Waiting for deploy to finish 2024-01-21T20:29:10.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:29:13.820 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-01-21T20:29:19.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:29:22.876 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-01-21T20:29:28.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:29:31.964 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-01-21T20:29:37.970 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:29:41.052 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-01-21T20:29:47.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:29:50.108 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-01-21T20:29:56.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:30:55.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:30:56.118 WARNING:teuthology.provision.fog.smithi017:timed out 2024-01-21T20:30:58.364 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:02.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:02.384 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T20:31:02.384 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T20:31:02.626 INFO:teuthology.provision.fog.smithi017:Node is ready 2024-01-21T20:31:02.627 DEBUG:teuthology.orchestra.run.smithi017:> hostname 2024-01-21T20:31:02.647 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com 2024-01-21T20:31:02.647 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts 2024-01-21T20:31:02.707 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017 2024-01-21T20:31:02.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-01-21T20:31:02.819 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts 2024-01-21T20:31:02.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts 2024-01-21T20:31:02.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname 2024-01-21T20:31:02.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017 2024-01-21T20:31:03.056 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-01-21T20:31:03.114 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T20:31:03.115 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T20:31:03.116 INFO:teuthology.provision.fog.smithi017:Deploy complete! 2024-01-21T20:31:03.117 DEBUG:teuthology.parallel:result is None 2024-01-21T20:31:04.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:07.420 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:13.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:16.476 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:22.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:25.564 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:31.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:34.652 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:40.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:43.740 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:49.747 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:31:52.828 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:31:58.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:32:01.916 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:32:07.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:32:26.428 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:32:32.432 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:32:35.484 WARNING:teuthology.provision.fog.smithi076:[Errno None] Unable to connect to port 22 on 172.21.15.76 2024-01-21T20:32:41.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:32:42.891 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-21T20:32:42.891 DEBUG:teuthology.orchestra.run.smithi076:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-21T20:33:08.112 INFO:teuthology.provision.fog.smithi076:Node is ready 2024-01-21T20:33:08.112 DEBUG:teuthology.orchestra.run.smithi076:> hostname 2024-01-21T20:33:08.136 INFO:teuthology.orchestra.run.smithi076.stdout:smithi076.front.sepia.ceph.com 2024-01-21T20:33:08.137 DEBUG:teuthology.orchestra.run.smithi076:> grep smithi076.front.sepia.ceph.com /etc/hosts 2024-01-21T20:33:08.198 INFO:teuthology.orchestra.run.smithi076.stdout:172.21.15.76 smithi076.front.sepia.ceph.com smithi076 2024-01-21T20:33:08.199 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-21T20:33:08.327 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hosts 2024-01-21T20:33:08.361 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/172.21.15.76/172.21.15.76/g' /etc/hosts 2024-01-21T20:33:08.435 DEBUG:teuthology.orchestra.run.smithi076:> sudo sed -i -e 's/smithi076.front.sepia.ceph.com/smithi076/g' /etc/hostname 2024-01-21T20:33:08.508 DEBUG:teuthology.orchestra.run.smithi076:> sudo hostname smithi076 2024-01-21T20:33:08.581 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-21T20:33:08.642 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-01-21T20:33:08.642 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-01-21T20:33:08.642 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T20:33:08.643 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T20:33:08.643 INFO:teuthology.provision.fog.smithi076:Deploy complete! 2024-01-21T20:33:08.644 DEBUG:teuthology.parallel:result is None 2024-01-21T20:33:08.805 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com 2024-01-21T20:33:08.805 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T20:33:08.829 INFO:teuthology.lock.ops:Checking smithi076.front.sepia.ceph.com 2024-01-21T20:33:08.829 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-21T20:33:08.847 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server 2024-01-21T20:33:08.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-01-21T20:33:08.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:33:08.921 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-01-21T20:33:09.064 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-01-21T20:33:09.064 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-01-21T20:33:09.124 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-01-21T20:33:09.124 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="8" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="8" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el8" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-01-21T20:33:09.184 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T20:33:09.185 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T20:33:09.185 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T20:33:09.185 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-01-21T20:33:09.205 INFO:teuthology.lock.ops:Updating [smithi076.front.sepia.ceph.com]: set os type and version on server 2024-01-21T20:33:09.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-21T20:33:09.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi076.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-21T20:33:09.317 DEBUG:teuthology.orchestra.run.smithi076:> true 2024-01-21T20:33:09.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi076.front.sepia.ceph.com' 2024-01-21T20:33:09.394 DEBUG:teuthology.orchestra.run.smithi076:> uname -m 2024-01-21T20:33:09.456 INFO:teuthology.orchestra.run.smithi076.stdout:x86_64 2024-01-21T20:33:09.456 DEBUG:teuthology.orchestra.run.smithi076:> cat /etc/os-release 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:NAME="CentOS Stream" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION="8" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:ID="centos" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:ID_LIKE="rhel fedora" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:VERSION_ID="8" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:PLATFORM_ID="platform:el8" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:ANSI_COLOR="0;31" 2024-01-21T20:33:09.518 INFO:teuthology.orchestra.run.smithi076.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-21T20:33:09.519 INFO:teuthology.orchestra.run.smithi076.stdout:HOME_URL="https://centos.org/" 2024-01-21T20:33:09.519 INFO:teuthology.orchestra.run.smithi076.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-21T20:33:09.519 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-21T20:33:09.519 INFO:teuthology.orchestra.run.smithi076.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-21T20:33:09.519 INFO:teuthology.lock.ops:Updating smithi076.front.sepia.ceph.com on lock server 2024-01-21T20:33:09.538 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:33:09.640 INFO:teuthology.dispatcher.supervisor:Running job 7521881 2024-01-21T20:33:09.640 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521881 --name vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521881/orig.config.yaml 2024-01-21T20:33:09.642 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521881 2024-01-21T20:33:09.643 INFO:teuthology.dispatcher.supervisor:Job PID: 874843 2024-01-21T20:33:09.643 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-21T20:35:09.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:37:09.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:39:10.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:41:10.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:43:10.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:45:10.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:47:10.744 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:49:10.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:51:11.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:53:11.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:55:11.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:57:11.548 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:59:11.708 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-21T20:59:11.778 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-21T20:59:11.894 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-21T20:59:11.894 INFO:teuthology.nuke:Checking targets against current locks 2024-01-21T20:59:11.943 DEBUG:teuthology.nuke:shortname: smithi017 2024-01-21T20:59:11.943 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T20:59:11.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521881', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 20:25:17.546329', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH/Gvj0ZDQH9NkwQxIMxYynPp7MobYPVklcz8xww60S6e4/yWPzQAYPAdkYUzFMFZ0sPeSscVrRbtq1zm+DSoQc='} 2024-01-21T20:59:11.970 DEBUG:teuthology.nuke:shortname: smithi076 2024-01-21T20:59:11.970 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-21T20:59:11.994 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi076.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-01-19_10:13:34-fs-wip-vshankar-testing-20240119.075157-testing-default-smithi/7521881', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-21 20:25:17.547814', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN0xgZWaSy4NJkP4SQvDynuavbzDU2pVmAZhYsUBSYHmUZ+jKFURCGenow5mMcvaO0f3hjFHCuB7h4ovPs5K/BQ='} 2024-01-21T20:59:12.019 INFO:teuthology.orchestra.console.smithi017:Power off 2024-01-21T20:59:12.019 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T20:59:12.040 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-01-21T20:59:12.040 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:59:12.057 INFO:teuthology.orchestra.console.smithi076:Power off 2024-01-21T20:59:12.057 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-21T20:59:12.065 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-01-21T20:59:12.078 DEBUG:teuthology.orchestra.console.smithi076:power off output: Chassis Power Control: Down/Off 2024-01-21T20:59:12.078 DEBUG:teuthology.orchestra.console.smithi076:pexpect command: ipmitool -H smithi076.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-21T20:59:12.101 DEBUG:teuthology.orchestra.console.smithi076:check power output: Chassis Power is off 2024-01-21T20:59:12.166 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-01-21T20:59:12.203 INFO:teuthology.orchestra.console.smithi076:Power off completed 2024-01-21T20:59:12.318 INFO:teuthology.lock.ops:unlocked: smithi017.front.sepia.ceph.com 2024-01-21T20:59:12.351 INFO:teuthology.lock.ops:unlocked: smithi076.front.sepia.ceph.com