2024-04-05T22:06:39.358 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-05T22:06:39.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:06:39.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3531768c10>, signals=[15]) 2024-04-05T22:06:39.493 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2024-04-05T22:06:39.493 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2024-04-05T22:06:39.494 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-05T22:06:39.517 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging 2024-04-05T22:06:39.517 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server 2024-04-05T22:06:39.517 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-05T22:06:39.646 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3) 2024-04-05T22:06:39.649 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_8.stream (ID 3) 2024-04-05T22:06:39.691 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream 2024-04-05T22:06:39.698 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 8.stream 2024-04-05T22:06:40.007 INFO:teuthology.orchestra.console.smithi104:Power off 2024-04-05T22:06:40.007 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-05T22:06:40.021 INFO:teuthology.orchestra.console.smithi096:Power off 2024-04-05T22:06:40.021 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-05T22:06:40.030 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off 2024-04-05T22:06:40.031 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:40.042 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2024-04-05T22:06:40.042 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:40.051 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-05T22:06:40.062 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-04-05T22:06:44.054 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:44.063 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:44.165 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-05T22:06:44.172 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-04-05T22:06:48.170 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:48.177 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:48.279 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-05T22:06:48.285 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-04-05T22:06:48.386 INFO:teuthology.orchestra.console.smithi096:Power off completed 2024-04-05T22:06:48.486 INFO:teuthology.orchestra.console.smithi096:Power on 2024-04-05T22:06:48.487 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-05T22:06:48.510 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2024-04-05T22:06:48.510 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:48.531 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-04-05T22:06:52.284 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:52.397 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-05T22:06:52.498 INFO:teuthology.orchestra.console.smithi104:Power off completed 2024-04-05T22:06:52.532 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:52.599 INFO:teuthology.orchestra.console.smithi104:Power on 2024-04-05T22:06:52.599 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-05T22:06:52.621 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On 2024-04-05T22:06:52.622 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:52.643 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2024-04-05T22:06:52.648 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-05T22:06:56.646 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:56.655 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:06:56.763 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off 2024-04-05T22:06:56.805 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2024-04-05T22:06:56.905 INFO:teuthology.orchestra.console.smithi096:Power on completed 2024-04-05T22:06:57.006 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2024-04-05T22:07:00.766 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-05T22:07:00.875 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on 2024-04-05T22:07:00.976 INFO:teuthology.orchestra.console.smithi104:Power on completed 2024-04-05T22:07:01.076 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish 2024-04-05T22:09:42.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:09:45.822 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:09:46.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:09:49.854 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:09:51.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:09:54.878 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:09:55.857 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:09:58.910 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:10:00.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:03.934 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:10:04.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:07.966 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:10:09.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:12.990 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:10:13.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:17.022 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:10:18.994 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:22.046 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:10:23.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:26.078 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:10:28.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:31.102 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-05T22:10:32.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:35.134 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104 2024-04-05T22:10:37.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:10:41.139 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:11:37.149 WARNING:teuthology.provision.fog.smithi096:timed out 2024-04-05T22:11:41.146 WARNING:teuthology.provision.fog.smithi104:timed out 2024-04-05T22:11:43.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:11:43.450 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-05T22:11:43.451 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-05T22:11:43.704 INFO:teuthology.provision.fog.smithi096:Node is ready 2024-04-05T22:11:43.704 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2024-04-05T22:11:43.724 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2024-04-05T22:11:43.724 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2024-04-05T22:11:43.784 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2024-04-05T22:11:43.784 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2024-04-05T22:11:43.887 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2024-04-05T22:11:43.917 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2024-04-05T22:11:43.987 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2024-04-05T22:11:44.056 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2024-04-05T22:11:44.123 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-05T22:11:44.182 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-05T22:11:44.183 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-05T22:11:44.184 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2024-04-05T22:11:44.185 DEBUG:teuthology.parallel:result is None 2024-04-05T22:11:47.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:11:47.418 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-05T22:11:47.418 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-05T22:11:47.655 INFO:teuthology.provision.fog.smithi104:Node is ready 2024-04-05T22:11:47.655 DEBUG:teuthology.orchestra.run.smithi104:> hostname 2024-04-05T22:11:47.675 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com 2024-04-05T22:11:47.676 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts 2024-04-05T22:11:47.735 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104 2024-04-05T22:11:47.735 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-05T22:11:47.855 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts 2024-04-05T22:11:47.887 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts 2024-04-05T22:11:47.957 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname 2024-04-05T22:11:48.027 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104 2024-04-05T22:11:48.096 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-05T22:11:48.153 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-05T22:11:48.153 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2024-04-05T22:11:48.153 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-05T22:11:48.153 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-05T22:11:48.154 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-05T22:11:48.154 INFO:teuthology.provision.fog.smithi104:Deploy complete! 2024-04-05T22:11:48.155 DEBUG:teuthology.parallel:result is None 2024-04-05T22:11:48.341 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2024-04-05T22:11:48.342 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-05T22:11:48.363 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com 2024-04-05T22:11:48.363 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-05T22:11:48.382 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2024-04-05T22:11:48.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-05T22:11:48.382 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:11:48.462 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-05T22:11:48.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-05T22:11:48.534 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-05T22:11:48.594 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-05T22:11:48.594 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-05T22:11:48.653 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-05T22:11:48.654 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-05T22:11:48.655 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-05T22:11:48.680 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server 2024-04-05T22:11:48.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-05T22:11:48.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-05T22:11:48.752 DEBUG:teuthology.orchestra.run.smithi104:> true 2024-04-05T22:11:48.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com' 2024-04-05T22:11:48.779 DEBUG:teuthology.orchestra.run.smithi104:> uname -m 2024-04-05T22:11:48.838 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64 2024-04-05T22:11:48.838 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release 2024-04-05T22:11:48.896 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-05T22:11:48.897 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-05T22:11:48.898 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server 2024-04-05T22:11:48.921 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:11:49.026 INFO:teuthology.dispatcher.supervisor:Running job 7641675 2024-04-05T22:11:49.026 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-05_18:13:21-fs-wip-yuri4-testing-2024-04-04-1128-reef-distro-default-smithi/7641675 --name yuriw-2024-04-05_18:13:21-fs-wip-yuri4-testing-2024-04-04-1128-reef-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/yuriw-2024-04-05_18:13:21-fs-wip-yuri4-testing-2024-04-04-1128-reef-distro-default-smithi/7641675/orig.config.yaml 2024-04-05T22:11:49.030 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-05_18:13:21-fs-wip-yuri4-testing-2024-04-04-1128-reef-distro-default-smithi/7641675 2024-04-05T22:11:49.030 INFO:teuthology.dispatcher.supervisor:Job PID: 2619372 2024-04-05T22:11:49.030 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-05T22:13:49.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:15:49.308 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:17:49.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:19:49.662 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:21:49.827 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:23:49.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:25:50.166 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:27:50.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:29:50.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:31:50.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:33:50.815 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:35:50.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:37:51.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:39:51.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:41:51.510 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:43:51.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:45:51.808 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:47:51.979 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:49:52.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:51:52.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:53:52.481 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:55:52.668 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:57:52.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T22:59:53.006 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:01:53.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:03:53.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:05:53.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:07:53.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:09:53.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:11:54.029 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:13:54.203 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-05T23:13:54.277 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1