2024-04-17T05:21:38.777 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-17T05:21:38.777 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:21:38.933 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f271c132c10>, signals=[15]) 2024-04-17T05:21:38.933 INFO:teuthology.lock.ops:Start node 'smithi028.front.sepia.ceph.com' reimaging 2024-04-17T05:21:38.933 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T05:21:38.933 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-17T05:21:38.956 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-04-17T05:21:38.956 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-04-17T05:21:38.956 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-17T05:21:39.082 DEBUG:teuthology.provision.fog.smithi028:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T05:21:39.108 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-04-17T05:21:39.128 INFO:teuthology.provision.fog.smithi028:Scheduling deploy of centos 9.stream 2024-04-17T05:21:39.150 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-04-17T05:21:39.344 INFO:teuthology.orchestra.console.smithi028:Power off 2024-04-17T05:21:39.344 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T05:21:39.358 INFO:teuthology.orchestra.console.smithi119:Power off 2024-04-17T05:21:39.358 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-17T05:21:39.368 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2024-04-17T05:21:39.369 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:39.378 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-04-17T05:21:39.378 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:39.389 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-04-17T05:21:39.399 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-04-17T05:21:43.394 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:43.401 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:43.503 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-04-17T05:21:43.508 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-04-17T05:21:47.506 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:47.514 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:47.616 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T05:21:47.623 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-17T05:21:47.718 INFO:teuthology.orchestra.console.smithi028:Power off completed 2024-04-17T05:21:47.724 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-04-17T05:21:47.819 INFO:teuthology.orchestra.console.smithi028:Power on 2024-04-17T05:21:47.819 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T05:21:47.826 INFO:teuthology.orchestra.console.smithi119:Power on 2024-04-17T05:21:47.827 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-17T05:21:47.840 DEBUG:teuthology.orchestra.console.smithi028:power on output: Chassis Power Control: Up/On 2024-04-17T05:21:47.840 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:47.851 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-04-17T05:21:47.851 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:47.860 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T05:21:47.872 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-17T05:21:51.862 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:51.872 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:51.973 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-04-17T05:21:51.981 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-04-17T05:21:55.978 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:55.986 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-17T05:21:56.088 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-04-17T05:21:56.190 INFO:teuthology.orchestra.console.smithi028:Power on completed 2024-04-17T05:21:56.214 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-04-17T05:21:56.291 INFO:teuthology.provision.fog.smithi028:Waiting for deploy to finish 2024-04-17T05:21:56.316 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-04-17T05:21:56.417 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-04-17T05:24:11.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:15.038 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T05:24:21.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:24.098 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T05:24:27.030 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:30.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:30.110 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:24:33.182 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T05:24:36.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:39.170 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:24:39.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:42.238 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T05:24:45.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:48.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:48.254 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:24:51.298 WARNING:teuthology.provision.fog.smithi028:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-04-17T05:24:54.257 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:57.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:24:57.314 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:25:03.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:25:06.398 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:25:12.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:25:15.458 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:25:21.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:25:24.544 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-04-17T05:25:30.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:25:57.331 WARNING:teuthology.provision.fog.smithi028:timed out 2024-04-17T05:26:03.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:26:03.615 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T05:26:03.616 DEBUG:teuthology.orchestra.run.smithi028:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T05:26:03.903 INFO:teuthology.provision.fog.smithi028:Node is ready 2024-04-17T05:26:03.903 DEBUG:teuthology.orchestra.run.smithi028:> hostname 2024-04-17T05:26:03.918 INFO:teuthology.orchestra.run.smithi028.stdout:smithi028.front.sepia.ceph.com 2024-04-17T05:26:03.918 DEBUG:teuthology.orchestra.run.smithi028:> grep smithi028.front.sepia.ceph.com /etc/hosts 2024-04-17T05:26:03.973 INFO:teuthology.orchestra.run.smithi028.stdout:172.21.15.28 smithi028.front.sepia.ceph.com smithi028 2024-04-17T05:26:03.973 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-17T05:26:04.076 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hosts 2024-04-17T05:26:04.108 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/172.21.15.28/172.21.15.28/g' /etc/hosts 2024-04-17T05:26:04.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i -e 's/smithi028.front.sepia.ceph.com/smithi028/g' /etc/hostname 2024-04-17T05:26:04.251 DEBUG:teuthology.orchestra.run.smithi028:> sudo hostname smithi028 2024-04-17T05:26:04.322 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:26:04.378 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:26:04.379 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:26:04.379 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:26:04.379 INFO:teuthology.provision.fog.smithi028:Deploy complete! 2024-04-17T05:26:04.381 DEBUG:teuthology.parallel:result is None 2024-04-17T05:26:30.576 WARNING:teuthology.provision.fog.smithi119:timed out 2024-04-17T05:26:36.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:26:36.878 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-17T05:26:36.879 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-17T05:26:37.207 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-04-17T05:26:37.207 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-04-17T05:26:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-04-17T05:26:37.222 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-04-17T05:26:37.277 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-04-17T05:26:37.277 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-17T05:26:37.404 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-04-17T05:26:37.433 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-04-17T05:26:37.500 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-04-17T05:26:37.567 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-04-17T05:26:37.634 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-17T05:26:37.689 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:26:37.690 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:26:37.690 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:26:37.690 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:26:37.690 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:26:37.690 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:26:37.690 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-04-17T05:26:37.691 DEBUG:teuthology.parallel:result is None 2024-04-17T05:26:37.865 INFO:teuthology.lock.ops:Checking smithi028.front.sepia.ceph.com 2024-04-17T05:26:37.866 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T05:26:37.886 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-04-17T05:26:37.887 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-17T05:26:37.904 INFO:teuthology.lock.ops:Updating [smithi028.front.sepia.ceph.com]: set os type and version on server 2024-04-17T05:26:37.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-17T05:26:37.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:26:38.007 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-04-17T05:26:38.184 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-04-17T05:26:38.184 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-04-17T05:26:38.238 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-04-17T05:26:38.239 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-04-17T05:26:38.293 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-04-17T05:26:38.293 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:26:38.294 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:26:38.295 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-04-17T05:26:38.320 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-04-17T05:26:38.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-17T05:26:38.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-17T05:26:38.408 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-04-17T05:26:38.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-04-17T05:26:38.472 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-04-17T05:26:38.527 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-04-17T05:26:38.527 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-04-17T05:26:38.580 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-04-17T05:26:38.580 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-17T05:26:38.581 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-17T05:26:38.582 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-04-17T05:26:38.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:26:38.698 INFO:teuthology.dispatcher.supervisor:Running job 7659850 2024-04-17T05:26:38.698 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659850 --name rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659850/orig.config.yaml 2024-04-17T05:26:38.701 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2024-04-17_04:58:44-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7659850 2024-04-17T05:26:38.702 INFO:teuthology.dispatcher.supervisor:Job PID: 3939865 2024-04-17T05:26:38.702 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-17T05:28:38.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:30:38.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:32:39.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:34:39.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:36:39.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:38:39.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:40:39.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:42:39.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:44:40.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:46:40.299 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:48:40.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:50:40.639 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:52:40.812 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:54:40.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:56:41.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T05:58:41.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:00:41.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:02:41.673 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:04:41.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:06:42.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:08:42.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:10:42.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:12:42.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:14:42.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:16:42.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:18:43.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:20:43.216 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:22:43.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:24:43.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:26:43.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:28:43.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:30:44.039 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:32:44.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:34:44.404 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:36:44.579 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:38:44.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:40:44.939 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:42:45.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:44:45.256 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:46:45.423 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:48:45.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:50:45.761 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:52:45.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:54:46.087 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:56:46.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T06:58:46.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T07:00:46.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T07:02:46.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T07:04:46.943 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-17T07:04:47.037 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1