2024-04-10T20:26:37.072 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-10T20:26:37.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:26:37.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0a7fb18c10>, signals=[15]) 2024-04-10T20:26:37.298 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2024-04-10T20:26:37.299 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:26:37.299 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-10T20:26:37.333 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2024-04-10T20:26:37.333 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:26:37.333 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-10T20:26:37.374 INFO:teuthology.lock.ops:Start node 'smithi187.front.sepia.ceph.com' reimaging 2024-04-10T20:26:37.374 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: reset os type and version on server 2024-04-10T20:26:37.374 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-10T20:26:37.499 DEBUG:teuthology.provision.fog.smithi088:Requesting image smithi_centos_8.stream (ID 3) 2024-04-10T20:26:37.562 DEBUG:teuthology.provision.fog.smithi161:Requesting image smithi_centos_8.stream (ID 3) 2024-04-10T20:26:37.595 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of centos 8.stream 2024-04-10T20:26:37.615 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2024-04-10T20:26:37.632 DEBUG:teuthology.provision.fog.smithi187:Requesting image smithi_centos_8.stream (ID 3) 2024-04-10T20:26:37.707 INFO:teuthology.provision.fog.smithi187:Scheduling deploy of centos 8.stream 2024-04-10T20:26:38.175 INFO:teuthology.orchestra.console.smithi088:Power off 2024-04-10T20:26:38.176 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:26:38.189 INFO:teuthology.orchestra.console.smithi161:Power off 2024-04-10T20:26:38.189 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:26:38.210 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2024-04-10T20:26:38.210 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.233 INFO:teuthology.orchestra.console.smithi187:Power off 2024-04-10T20:26:38.233 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-10T20:26:38.241 DEBUG:teuthology.orchestra.console.smithi161:power off output: Chassis Power Control: Down/Off 2024-04-10T20:26:38.242 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.250 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-10T20:26:38.265 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2024-04-10T20:26:38.265 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.274 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-10T20:26:38.300 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-10T20:26:38.351 INFO:teuthology.orchestra.console.smithi088:Power off completed 2024-04-10T20:26:38.375 INFO:teuthology.orchestra.console.smithi161:Power off completed 2024-04-10T20:26:38.401 INFO:teuthology.orchestra.console.smithi187:Power off completed 2024-04-10T20:26:38.452 INFO:teuthology.orchestra.console.smithi088:Power on 2024-04-10T20:26:38.452 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:26:38.475 INFO:teuthology.orchestra.console.smithi161:Power on 2024-04-10T20:26:38.476 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:26:38.485 DEBUG:teuthology.orchestra.console.smithi088:power on output: Chassis Power Control: Up/On 2024-04-10T20:26:38.485 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.502 INFO:teuthology.orchestra.console.smithi187:Power on 2024-04-10T20:26:38.502 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-10T20:26:38.510 DEBUG:teuthology.orchestra.console.smithi161:power on output: Chassis Power Control: Up/On 2024-04-10T20:26:38.511 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.519 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2024-04-10T20:26:38.536 DEBUG:teuthology.orchestra.console.smithi187:power on output: Chassis Power Control: Up/On 2024-04-10T20:26:38.536 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:38.543 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is off 2024-04-10T20:26:38.584 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2024-04-10T20:26:42.525 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:42.544 DEBUG:teuthology.orchestra.console.smithi161:pexpect command: ipmitool -H smithi161.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:42.585 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-10T20:26:42.634 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2024-04-10T20:26:42.652 DEBUG:teuthology.orchestra.console.smithi161:check power output: Chassis Power is on 2024-04-10T20:26:42.692 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2024-04-10T20:26:42.735 INFO:teuthology.orchestra.console.smithi088:Power on completed 2024-04-10T20:26:42.753 INFO:teuthology.orchestra.console.smithi161:Power on completed 2024-04-10T20:26:42.794 INFO:teuthology.orchestra.console.smithi187:Power on completed 2024-04-10T20:26:42.836 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2024-04-10T20:26:42.854 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2024-04-10T20:26:42.894 INFO:teuthology.provision.fog.smithi187:Waiting for deploy to finish 2024-04-10T20:30:31.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:30:34.878 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:30:40.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:30:43.966 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:30:49.971 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:30:53.054 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:30:59.060 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:02.151 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:02.217 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:31:05.278 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:08.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:11.282 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:11.314 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:31:14.366 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:17.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:17.340 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:20.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:20.414 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:31:20.446 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:31:23.454 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:26.419 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:26.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:29.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:29.502 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:31:29.534 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:31:32.543 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:35.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:35.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:38.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:38.590 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:31:38.622 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:31:41.630 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:44.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:44.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:47.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:47.710 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:31:50.718 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:31:53.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:56.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:31:56.798 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:31:59.806 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:32:02.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:03.102 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:32:05.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:05.922 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:32:09.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:11.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:12.190 WARNING:teuthology.provision.fog.smithi088:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-04-10T20:32:15.006 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:32:18.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:20.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:32:20.224 DEBUG:teuthology.orchestra.run.smithi088:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:32:21.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:24.350 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:32:30.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:33.438 WARNING:teuthology.provision.fog.smithi161:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-04-10T20:32:39.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:39.454 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:32:39.701 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:32:39.701 DEBUG:teuthology.orchestra.run.smithi161:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:32:45.456 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:45.866 INFO:teuthology.provision.fog.smithi088:Node is ready 2024-04-10T20:32:45.867 DEBUG:teuthology.orchestra.run.smithi088:> hostname 2024-04-10T20:32:45.891 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088.front.sepia.ceph.com 2024-04-10T20:32:45.891 DEBUG:teuthology.orchestra.run.smithi088:> grep smithi088.front.sepia.ceph.com /etc/hosts 2024-04-10T20:32:45.952 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2024-04-10T20:32:45.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-04-10T20:32:46.064 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hosts 2024-04-10T20:32:46.096 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/172.21.15.88/172.21.15.88/g' /etc/hosts 2024-04-10T20:32:46.165 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i -e 's/smithi088.front.sepia.ceph.com/smithi088/g' /etc/hostname 2024-04-10T20:32:46.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname smithi088 2024-04-10T20:32:46.303 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:32:46.361 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-10T20:32:46.362 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:32:46.362 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:32:46.362 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:32:46.362 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:32:46.362 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:32:46.363 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2024-04-10T20:32:46.364 DEBUG:teuthology.parallel:result is None 2024-04-10T20:32:48.542 WARNING:teuthology.provision.fog.smithi187:[Errno None] Unable to connect to port 22 on 172.21.15.187 2024-04-10T20:32:54.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:32:55.082 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-10T20:32:55.083 DEBUG:teuthology.orchestra.run.smithi187:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-10T20:33:04.486 INFO:teuthology.provision.fog.smithi161:Node is ready 2024-04-10T20:33:04.486 DEBUG:teuthology.orchestra.run.smithi161:> hostname 2024-04-10T20:33:04.510 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2024-04-10T20:33:04.511 DEBUG:teuthology.orchestra.run.smithi161:> grep smithi161.front.sepia.ceph.com /etc/hosts 2024-04-10T20:33:04.570 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2024-04-10T20:33:04.571 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-10T20:33:04.695 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hosts 2024-04-10T20:33:04.726 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/172.21.15.161/172.21.15.161/g' /etc/hosts 2024-04-10T20:33:04.795 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i -e 's/smithi161.front.sepia.ceph.com/smithi161/g' /etc/hostname 2024-04-10T20:33:04.864 DEBUG:teuthology.orchestra.run.smithi161:> sudo hostname smithi161 2024-04-10T20:33:04.932 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-04-10T20:33:04.990 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:33:04.991 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:33:04.991 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2024-04-10T20:33:04.992 DEBUG:teuthology.parallel:result is None 2024-04-10T20:33:20.421 INFO:teuthology.provision.fog.smithi187:Node is ready 2024-04-10T20:33:20.422 DEBUG:teuthology.orchestra.run.smithi187:> hostname 2024-04-10T20:33:20.486 INFO:teuthology.orchestra.run.smithi187.stdout:smithi187.front.sepia.ceph.com 2024-04-10T20:33:20.486 DEBUG:teuthology.orchestra.run.smithi187:> grep smithi187.front.sepia.ceph.com /etc/hosts 2024-04-10T20:33:20.547 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.15.187 smithi187.front.sepia.ceph.com smithi187 2024-04-10T20:33:20.547 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-10T20:33:20.673 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hosts 2024-04-10T20:33:20.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/172.21.15.187/172.21.15.187/g' /etc/hosts 2024-04-10T20:33:20.773 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i -e 's/smithi187.front.sepia.ceph.com/smithi187/g' /etc/hostname 2024-04-10T20:33:20.842 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname smithi187 2024-04-10T20:33:20.911 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:33:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:33:20.971 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:33:20.971 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:33:20.971 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:33:20.971 INFO:teuthology.provision.fog.smithi187:Deploy complete! 2024-04-10T20:33:20.971 DEBUG:teuthology.parallel:result is None 2024-04-10T20:33:21.399 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2024-04-10T20:33:21.400 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:33:21.449 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2024-04-10T20:33:21.449 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:33:21.490 INFO:teuthology.lock.ops:Checking smithi187.front.sepia.ceph.com 2024-04-10T20:33:21.490 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-10T20:33:21.525 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:33:21.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-10T20:33:21.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:33:21.613 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-04-10T20:33:21.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-04-10T20:33:21.749 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-04-10T20:33:21.809 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-04-10T20:33:21.809 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:33:21.868 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:33:21.869 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:33:21.869 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:33:21.869 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:33:21.869 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-04-10T20:33:21.899 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:33:21.899 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-10T20:33:21.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:33:21.984 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-04-10T20:33:22.121 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-04-10T20:33:22.121 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-04-10T20:33:22.180 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-04-10T20:33:22.180 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:33:22.239 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:33:22.240 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:33:22.240 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-04-10T20:33:22.273 INFO:teuthology.lock.ops:Updating [smithi187.front.sepia.ceph.com]: set os type and version on server 2024-04-10T20:33:22.274 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-10T20:33:22.274 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-10T20:33:22.355 DEBUG:teuthology.orchestra.run.smithi187:> true 2024-04-10T20:33:22.428 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2024-04-10T20:33:22.428 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2024-04-10T20:33:22.488 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2024-04-10T20:33:22.488 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2024-04-10T20:33:22.550 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-10T20:33:22.551 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-10T20:33:22.551 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2024-04-10T20:33:22.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:33:22.710 INFO:teuthology.dispatcher.supervisor:Running job 7651203 2024-04-10T20:33:22.710 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651203 --name yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651203/orig.config.yaml 2024-04-10T20:33:22.713 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-04-10_14:20:47-rados-wip-yuri10-testing-2024-03-24-1159-distro-default-smithi/7651203 2024-04-10T20:33:22.714 INFO:teuthology.dispatcher.supervisor:Job PID: 3338448 2024-04-10T20:33:22.714 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-10T20:35:22.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:37:22.950 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:39:23.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:41:23.213 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:43:23.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:45:23.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:47:23.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:49:23.899 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:51:24.067 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:53:24.248 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:55:24.435 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:57:24.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T20:59:24.692 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T21:01:24.860 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T21:03:25.040 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T21:05:25.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T21:07:25.364 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-10T21:07:25.460 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1