2024-02-07T20:21:18.183 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-07T20:21:18.184 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:21:18.356 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f03e3c9dc10>, signals=[15]) 2024-02-07T20:21:18.356 INFO:teuthology.lock.ops:Start node 'smithi067.front.sepia.ceph.com' reimaging 2024-02-07T20:21:18.357 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T20:21:18.357 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-02-07T20:21:18.391 INFO:teuthology.lock.ops:Start node 'smithi102.front.sepia.ceph.com' reimaging 2024-02-07T20:21:18.391 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T20:21:18.391 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-02-07T20:21:18.416 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-02-07T20:21:18.416 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-02-07T20:21:18.416 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-07T20:21:18.501 DEBUG:teuthology.provision.fog.smithi067:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T20:21:18.525 DEBUG:teuthology.provision.fog.smithi102:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T20:21:18.542 INFO:teuthology.provision.fog.smithi067:Scheduling deploy of centos 8.stream 2024-02-07T20:21:18.551 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_8.stream (ID 3) 2024-02-07T20:21:18.563 INFO:teuthology.provision.fog.smithi102:Scheduling deploy of centos 8.stream 2024-02-07T20:21:18.598 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 8.stream 2024-02-07T20:21:18.803 INFO:teuthology.orchestra.console.smithi067:Power off 2024-02-07T20:21:18.803 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T20:21:18.817 INFO:teuthology.orchestra.console.smithi102:Power off 2024-02-07T20:21:18.817 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T20:21:18.827 DEBUG:teuthology.orchestra.console.smithi067:power off output: Chassis Power Control: Down/Off 2024-02-07T20:21:18.827 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:18.840 DEBUG:teuthology.orchestra.console.smithi102:power off output: Chassis Power Control: Down/Off 2024-02-07T20:21:18.840 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:18.853 INFO:teuthology.orchestra.console.smithi191:Power off 2024-02-07T20:21:18.854 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-07T20:21:18.860 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-02-07T20:21:18.862 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-02-07T20:21:18.874 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-02-07T20:21:18.874 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:18.896 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-07T20:21:18.962 INFO:teuthology.orchestra.console.smithi067:Power off completed 2024-02-07T20:21:18.963 INFO:teuthology.orchestra.console.smithi102:Power off completed 2024-02-07T20:21:18.998 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-02-07T20:21:19.063 INFO:teuthology.orchestra.console.smithi067:Power on 2024-02-07T20:21:19.063 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T20:21:19.076 INFO:teuthology.orchestra.console.smithi102:Power on 2024-02-07T20:21:19.077 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T20:21:19.091 DEBUG:teuthology.orchestra.console.smithi067:power on output: Chassis Power Control: Up/On 2024-02-07T20:21:19.091 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:19.098 INFO:teuthology.orchestra.console.smithi191:Power on 2024-02-07T20:21:19.099 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-07T20:21:19.108 DEBUG:teuthology.orchestra.console.smithi102:power on output: Chassis Power Control: Up/On 2024-02-07T20:21:19.109 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:19.117 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is off 2024-02-07T20:21:19.121 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-02-07T20:21:19.121 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:19.129 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is off 2024-02-07T20:21:19.141 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-07T20:21:23.122 DEBUG:teuthology.orchestra.console.smithi067:pexpect command: ipmitool -H smithi067.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:23.130 DEBUG:teuthology.orchestra.console.smithi102:pexpect command: ipmitool -H smithi102.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:23.143 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:23.231 DEBUG:teuthology.orchestra.console.smithi067:check power output: Chassis Power is on 2024-02-07T20:21:23.238 DEBUG:teuthology.orchestra.console.smithi102:check power output: Chassis Power is on 2024-02-07T20:21:23.250 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-02-07T20:21:23.333 INFO:teuthology.orchestra.console.smithi067:Power on completed 2024-02-07T20:21:23.339 INFO:teuthology.orchestra.console.smithi102:Power on completed 2024-02-07T20:21:23.434 INFO:teuthology.provision.fog.smithi067:Waiting for deploy to finish 2024-02-07T20:21:23.440 INFO:teuthology.provision.fog.smithi102:Waiting for deploy to finish 2024-02-07T20:21:27.255 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-07T20:21:27.367 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-02-07T20:21:27.468 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-02-07T20:21:27.569 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-02-07T20:24:09.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:09.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:12.447 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:12.447 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:13.407 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:16.476 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:24:18.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:18.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:21.500 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:21.532 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:22.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:25.535 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:24:27.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:27.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:30.556 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:30.588 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:31.538 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:34.620 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:24:36.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:36.589 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:39.612 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:39.648 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:40.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:43.676 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:24:45.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:45.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:48.668 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:48.700 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:49.679 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:52.732 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:24:54.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:54.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:24:57.724 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:24:57.756 WARNING:teuthology.provision.fog.smithi102:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-02-07T20:24:58.735 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:01.788 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:25:03.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:03.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:06.780 WARNING:teuthology.provision.fog.smithi067:[Errno None] Unable to connect to port 22 on 172.21.15.67 2024-02-07T20:25:07.790 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:12.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:26.332 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:25:32.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:35.424 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-02-07T20:25:35.555 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T20:25:35.556 DEBUG:teuthology.orchestra.run.smithi102:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T20:25:41.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:25:41.711 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T20:25:41.712 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T20:26:01.235 INFO:teuthology.provision.fog.smithi102:Node is ready 2024-02-07T20:26:01.235 DEBUG:teuthology.orchestra.run.smithi102:> hostname 2024-02-07T20:26:01.260 INFO:teuthology.orchestra.run.smithi102.stdout:smithi102.front.sepia.ceph.com 2024-02-07T20:26:01.260 DEBUG:teuthology.orchestra.run.smithi102:> grep smithi102.front.sepia.ceph.com /etc/hosts 2024-02-07T20:26:01.324 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.15.102 smithi102.front.sepia.ceph.com smithi102 2024-02-07T20:26:01.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-02-07T20:26:01.463 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hosts 2024-02-07T20:26:01.497 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/172.21.15.102/172.21.15.102/g' /etc/hosts 2024-02-07T20:26:01.571 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i -e 's/smithi102.front.sepia.ceph.com/smithi102/g' /etc/hostname 2024-02-07T20:26:01.645 DEBUG:teuthology.orchestra.run.smithi102:> sudo hostname smithi102 2024-02-07T20:26:01.717 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:01.778 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:01.779 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:01.779 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:01.779 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:01.779 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:01.779 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:01.780 INFO:teuthology.provision.fog.smithi102:Deploy complete! 2024-02-07T20:26:01.781 DEBUG:teuthology.parallel:result is None 2024-02-07T20:26:07.164 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-02-07T20:26:07.164 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-02-07T20:26:07.188 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-02-07T20:26:07.188 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-02-07T20:26:07.254 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-02-07T20:26:07.254 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-07T20:26:07.378 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-02-07T20:26:07.410 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-02-07T20:26:07.483 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-02-07T20:26:07.553 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-02-07T20:26:07.622 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-07T20:26:07.680 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:07.681 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:07.682 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-02-07T20:26:07.682 DEBUG:teuthology.parallel:result is None 2024-02-07T20:26:12.794 WARNING:teuthology.provision.fog.smithi067:timed out 2024-02-07T20:26:18.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:26:19.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-07T20:26:19.075 DEBUG:teuthology.orchestra.run.smithi067:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-07T20:26:19.328 INFO:teuthology.provision.fog.smithi067:Node is ready 2024-02-07T20:26:19.328 DEBUG:teuthology.orchestra.run.smithi067:> hostname 2024-02-07T20:26:19.347 INFO:teuthology.orchestra.run.smithi067.stdout:smithi067.front.sepia.ceph.com 2024-02-07T20:26:19.348 DEBUG:teuthology.orchestra.run.smithi067:> grep smithi067.front.sepia.ceph.com /etc/hosts 2024-02-07T20:26:19.407 INFO:teuthology.orchestra.run.smithi067.stdout:172.21.15.67 smithi067.front.sepia.ceph.com smithi067 2024-02-07T20:26:19.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-02-07T20:26:19.502 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hosts 2024-02-07T20:26:19.532 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/172.21.15.67/172.21.15.67/g' /etc/hosts 2024-02-07T20:26:19.602 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i -e 's/smithi067.front.sepia.ceph.com/smithi067/g' /etc/hostname 2024-02-07T20:26:19.670 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname smithi067 2024-02-07T20:26:19.739 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-02-07T20:26:19.797 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-02-07T20:26:19.797 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2024-02-07T20:26:19.797 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:19.798 INFO:teuthology.provision.fog.smithi067:Deploy complete! 2024-02-07T20:26:19.799 DEBUG:teuthology.parallel:result is None 2024-02-07T20:26:20.000 INFO:teuthology.lock.ops:Checking smithi067.front.sepia.ceph.com 2024-02-07T20:26:20.000 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T20:26:20.047 INFO:teuthology.lock.ops:Checking smithi102.front.sepia.ceph.com 2024-02-07T20:26:20.047 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T20:26:20.071 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-02-07T20:26:20.071 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-07T20:26:20.090 INFO:teuthology.lock.ops:Updating [smithi067.front.sepia.ceph.com]: set os type and version on server 2024-02-07T20:26:20.090 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-02-07T20:26:20.091 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:26:20.171 DEBUG:teuthology.orchestra.run.smithi067:> true 2024-02-07T20:26:20.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2024-02-07T20:26:20.239 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2024-02-07T20:26:20.297 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2024-02-07T20:26:20.297 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2024-02-07T20:26:20.357 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2024-02-07T20:26:20.357 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2024-02-07T20:26:20.357 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2024-02-07T20:26:20.357 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:20.358 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2024-02-07T20:26:20.358 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:20.358 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:20.358 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:20.358 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:20.359 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:20.359 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:20.359 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:20.359 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:20.360 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2024-02-07T20:26:20.380 INFO:teuthology.lock.ops:Updating [smithi102.front.sepia.ceph.com]: set os type and version on server 2024-02-07T20:26:20.381 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-02-07T20:26:20.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:26:20.478 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-02-07T20:26:20.569 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-02-07T20:26:20.569 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-02-07T20:26:20.630 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-02-07T20:26:20.630 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-02-07T20:26:20.689 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-02-07T20:26:20.689 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:20.690 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:20.691 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-02-07T20:26:20.713 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-02-07T20:26:20.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-07T20:26:20.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-07T20:26:20.787 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-02-07T20:26:20.923 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-02-07T20:26:20.923 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-02-07T20:26:20.982 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-02-07T20:26:20.982 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-02-07T20:26:21.041 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-02-07T20:26:21.041 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="8" 2024-02-07T20:26:21.041 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-02-07T20:26:21.041 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-02-07T20:26:21.041 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="8" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el8" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-07T20:26:21.042 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-07T20:26:21.042 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-02-07T20:26:21.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:26:21.160 INFO:teuthology.dispatcher.supervisor:Running job 7550450 2024-02-07T20:26:21.160 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d9fdb2209e15b39d9f061fd85399f352ce0f0894/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550450 --name yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi --description rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/reef backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} -- /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550450/orig.config.yaml 2024-02-07T20:26:21.164 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-07_16:43:11-rados-wip-yuri6-testing-2024-02-06-1313-distro-default-smithi/7550450 2024-02-07T20:26:21.164 INFO:teuthology.dispatcher.supervisor:Job PID: 1775351 2024-02-07T20:26:21.165 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-07T20:28:21.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:30:21.374 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:32:21.550 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:34:21.725 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:36:21.900 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:38:22.064 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:40:22.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-07T20:40:22.340 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1