2024-03-19T11:41:52.130 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-19T11:41:52.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:41:52.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f85e28d9c10>, signals=[15]) 2024-03-19T11:41:52.306 INFO:teuthology.lock.ops:Start node 'smithi044.front.sepia.ceph.com' reimaging 2024-03-19T11:41:52.306 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: reset os type and version on server 2024-03-19T11:41:52.306 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-19T11:41:52.342 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2024-03-19T11:41:52.342 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2024-03-19T11:41:52.342 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-03-19T11:41:52.366 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2024-03-19T11:41:52.366 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2024-03-19T11:41:52.366 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-03-19T11:41:52.467 DEBUG:teuthology.provision.fog.smithi044:Requesting image smithi_centos_9.stream (ID 10) 2024-03-19T11:41:52.498 DEBUG:teuthology.provision.fog.smithi167:Requesting image smithi_centos_9.stream (ID 10) 2024-03-19T11:41:52.500 DEBUG:teuthology.provision.fog.smithi191:Requesting image smithi_centos_9.stream (ID 10) 2024-03-19T11:41:52.515 INFO:teuthology.provision.fog.smithi044:Scheduling deploy of centos 9.stream 2024-03-19T11:41:52.544 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of centos 9.stream 2024-03-19T11:41:52.547 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of centos 9.stream 2024-03-19T11:41:52.795 INFO:teuthology.orchestra.console.smithi044:Power off 2024-03-19T11:41:52.795 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T11:41:52.824 DEBUG:teuthology.orchestra.console.smithi044:power off output: Chassis Power Control: Down/Off 2024-03-19T11:41:52.824 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:52.846 INFO:teuthology.orchestra.console.smithi191:Power off 2024-03-19T11:41:52.846 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T11:41:52.859 INFO:teuthology.orchestra.console.smithi167:Power off 2024-03-19T11:41:52.859 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-19T11:41:52.866 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-19T11:41:52.868 DEBUG:teuthology.orchestra.console.smithi191:power off output: Chassis Power Control: Down/Off 2024-03-19T11:41:52.869 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:52.879 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-03-19T11:41:52.880 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:52.890 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-03-19T11:41:52.902 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-03-19T11:41:52.991 INFO:teuthology.orchestra.console.smithi191:Power off completed 2024-03-19T11:41:53.092 INFO:teuthology.orchestra.console.smithi191:Power on 2024-03-19T11:41:53.092 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-19T11:41:53.113 DEBUG:teuthology.orchestra.console.smithi191:power on output: Chassis Power Control: Up/On 2024-03-19T11:41:53.114 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:53.136 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-03-19T11:41:56.870 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:56.903 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:56.983 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-19T11:41:57.013 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-03-19T11:41:57.084 INFO:teuthology.orchestra.console.smithi044:Power off completed 2024-03-19T11:41:57.114 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-03-19T11:41:57.137 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:57.185 INFO:teuthology.orchestra.console.smithi044:Power on 2024-03-19T11:41:57.185 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-19T11:41:57.206 DEBUG:teuthology.orchestra.console.smithi044:power on output: Chassis Power Control: Up/On 2024-03-19T11:41:57.206 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:57.215 INFO:teuthology.orchestra.console.smithi167:Power on 2024-03-19T11:41:57.215 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-03-19T11:41:57.228 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-19T11:41:57.238 DEBUG:teuthology.orchestra.console.smithi167:power on output: Chassis Power Control: Up/On 2024-03-19T11:41:57.238 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:41:57.248 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is off 2024-03-19T11:41:57.262 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-03-19T11:42:01.233 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:42:01.249 DEBUG:teuthology.orchestra.console.smithi191:pexpect command: ipmitool -H smithi191.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:42:01.262 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:42:01.343 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is off 2024-03-19T11:42:01.360 DEBUG:teuthology.orchestra.console.smithi191:check power output: Chassis Power is on 2024-03-19T11:42:01.371 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-03-19T11:42:01.461 INFO:teuthology.orchestra.console.smithi191:Power on completed 2024-03-19T11:42:01.562 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2024-03-19T11:42:05.346 DEBUG:teuthology.orchestra.console.smithi044:pexpect command: ipmitool -H smithi044.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:42:05.372 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-19T11:42:05.455 DEBUG:teuthology.orchestra.console.smithi044:check power output: Chassis Power is on 2024-03-19T11:42:05.513 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-03-19T11:42:05.557 INFO:teuthology.orchestra.console.smithi044:Power on completed 2024-03-19T11:42:05.614 INFO:teuthology.orchestra.console.smithi167:Power on completed 2024-03-19T11:42:05.658 INFO:teuthology.provision.fog.smithi044:Waiting for deploy to finish 2024-03-19T11:42:05.715 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2024-03-19T11:44:32.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:35.614 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:44:36.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:39.614 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:44:41.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:44.670 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:44:45.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:48.674 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:44:50.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:51.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:53.726 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:44:54.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:44:54.718 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:44:57.758 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:44:59.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:00.721 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:02.782 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:45:03.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:03.774 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:06.814 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:45:08.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:09.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:11.838 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:45:12.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:12.830 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:15.874 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:45:17.842 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:18.832 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:20.894 WARNING:teuthology.provision.fog.smithi191:[Errno None] Unable to connect to port 22 on 172.21.15.191 2024-03-19T11:45:21.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:21.890 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:24.926 WARNING:teuthology.provision.fog.smithi044:[Errno None] Unable to connect to port 22 on 172.21.15.44 2024-03-19T11:45:26.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:27.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:30.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:30.942 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:36.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:39.998 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:46.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:45:49.086 WARNING:teuthology.provision.fog.smithi167:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-19T11:45:55.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:46:26.931 WARNING:teuthology.provision.fog.smithi191:timed out 2024-03-19T11:46:30.938 WARNING:teuthology.provision.fog.smithi044:timed out 2024-03-19T11:46:32.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:46:33.210 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-19T11:46:33.211 DEBUG:teuthology.orchestra.run.smithi191:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-19T11:46:33.544 INFO:teuthology.provision.fog.smithi191:Node is ready 2024-03-19T11:46:33.544 DEBUG:teuthology.orchestra.run.smithi191:> hostname 2024-03-19T11:46:33.561 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2024-03-19T11:46:33.562 DEBUG:teuthology.orchestra.run.smithi191:> grep smithi191.front.sepia.ceph.com /etc/hosts 2024-03-19T11:46:33.620 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2024-03-19T11:46:33.620 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-03-19T11:46:33.745 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hosts 2024-03-19T11:46:33.774 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/172.21.15.191/172.21.15.191/g' /etc/hosts 2024-03-19T11:46:33.844 DEBUG:teuthology.orchestra.run.smithi191:> sudo sed -i -e 's/smithi191.front.sepia.ceph.com/smithi191/g' /etc/hostname 2024-03-19T11:46:33.913 DEBUG:teuthology.orchestra.run.smithi191:> sudo hostname smithi191 2024-03-19T11:46:33.980 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-03-19T11:46:34.035 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-03-19T11:46:34.035 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-03-19T11:46:34.035 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-03-19T11:46:34.035 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:46:34.036 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:46:34.037 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2024-03-19T11:46:34.038 DEBUG:teuthology.parallel:result is None 2024-03-19T11:46:36.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:46:37.201 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-19T11:46:37.201 DEBUG:teuthology.orchestra.run.smithi044:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-19T11:46:37.521 INFO:teuthology.provision.fog.smithi044:Node is ready 2024-03-19T11:46:37.521 DEBUG:teuthology.orchestra.run.smithi044:> hostname 2024-03-19T11:46:37.536 INFO:teuthology.orchestra.run.smithi044.stdout:smithi044.front.sepia.ceph.com 2024-03-19T11:46:37.536 DEBUG:teuthology.orchestra.run.smithi044:> grep smithi044.front.sepia.ceph.com /etc/hosts 2024-03-19T11:46:37.591 INFO:teuthology.orchestra.run.smithi044.stdout:172.21.15.44 smithi044.front.sepia.ceph.com smithi044 2024-03-19T11:46:37.591 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-03-19T11:46:37.705 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hosts 2024-03-19T11:46:37.737 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/172.21.15.44/172.21.15.44/g' /etc/hosts 2024-03-19T11:46:37.809 DEBUG:teuthology.orchestra.run.smithi044:> sudo sed -i -e 's/smithi044.front.sepia.ceph.com/smithi044/g' /etc/hostname 2024-03-19T11:46:37.879 DEBUG:teuthology.orchestra.run.smithi044:> sudo hostname smithi044 2024-03-19T11:46:37.949 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-19T11:46:38.004 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-19T11:46:38.004 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-19T11:46:38.004 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-19T11:46:38.004 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:46:38.004 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:46:38.005 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:46:38.005 INFO:teuthology.provision.fog.smithi044:Deploy complete! 2024-03-19T11:46:38.006 DEBUG:teuthology.parallel:result is None 2024-03-19T11:46:55.111 WARNING:teuthology.provision.fog.smithi167:timed out 2024-03-19T11:47:01.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:47:01.353 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-03-19T11:47:01.353 DEBUG:teuthology.orchestra.run.smithi167:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-03-19T11:47:01.696 INFO:teuthology.provision.fog.smithi167:Node is ready 2024-03-19T11:47:01.696 DEBUG:teuthology.orchestra.run.smithi167:> hostname 2024-03-19T11:47:01.711 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2024-03-19T11:47:01.711 DEBUG:teuthology.orchestra.run.smithi167:> grep smithi167.front.sepia.ceph.com /etc/hosts 2024-03-19T11:47:01.767 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2024-03-19T11:47:01.767 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-03-19T11:47:01.878 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hosts 2024-03-19T11:47:01.906 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/172.21.15.167/172.21.15.167/g' /etc/hosts 2024-03-19T11:47:01.976 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i -e 's/smithi167.front.sepia.ceph.com/smithi167/g' /etc/hostname 2024-03-19T11:47:02.044 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname smithi167 2024-03-19T11:47:02.111 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-03-19T11:47:02.166 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-03-19T11:47:02.166 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-03-19T11:47:02.166 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-03-19T11:47:02.166 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:47:02.167 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:47:02.167 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2024-03-19T11:47:02.168 DEBUG:teuthology.parallel:result is None 2024-03-19T11:47:02.424 INFO:teuthology.lock.ops:Checking smithi044.front.sepia.ceph.com 2024-03-19T11:47:02.424 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-19T11:47:02.448 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2024-03-19T11:47:02.448 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-19T11:47:02.464 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2024-03-19T11:47:02.465 INFO:teuthology.lock.ops:New key found. Updating... 2024-03-19T11:47:02.482 INFO:teuthology.lock.ops:Updating [smithi044.front.sepia.ceph.com]: set os type and version on server 2024-03-19T11:47:02.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-19T11:47:02.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:47:02.584 DEBUG:teuthology.orchestra.run.smithi044:> true 2024-03-19T11:47:02.769 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi044.front.sepia.ceph.com' 2024-03-19T11:47:02.770 DEBUG:teuthology.orchestra.run.smithi044:> uname -m 2024-03-19T11:47:02.825 INFO:teuthology.orchestra.run.smithi044.stdout:x86_64 2024-03-19T11:47:02.825 DEBUG:teuthology.orchestra.run.smithi044:> cat /etc/os-release 2024-03-19T11:47:02.880 INFO:teuthology.orchestra.run.smithi044.stdout:NAME="CentOS Stream" 2024-03-19T11:47:02.880 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION="9" 2024-03-19T11:47:02.880 INFO:teuthology.orchestra.run.smithi044.stdout:ID="centos" 2024-03-19T11:47:02.880 INFO:teuthology.orchestra.run.smithi044.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:VERSION_ID="9" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:ANSI_COLOR="0;31" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:47:02.881 INFO:teuthology.orchestra.run.smithi044.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:47:02.882 INFO:teuthology.lock.ops:Updating smithi044.front.sepia.ceph.com on lock server 2024-03-19T11:47:02.906 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2024-03-19T11:47:02.906 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-19T11:47:02.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:47:03.010 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-03-19T11:47:03.073 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-19T11:47:03.073 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-03-19T11:47:03.127 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-03-19T11:47:03.127 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-03-19T11:47:03.179 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:47:03.180 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:47:03.181 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:47:03.181 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:47:03.181 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-03-19T11:47:03.198 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2024-03-19T11:47:03.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-03-19T11:47:03.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi191.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-19T11:47:03.286 DEBUG:teuthology.orchestra.run.smithi191:> true 2024-03-19T11:47:03.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi191.front.sepia.ceph.com' 2024-03-19T11:47:03.456 DEBUG:teuthology.orchestra.run.smithi191:> uname -m 2024-03-19T11:47:03.511 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2024-03-19T11:47:03.512 DEBUG:teuthology.orchestra.run.smithi191:> cat /etc/os-release 2024-03-19T11:47:03.566 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="CentOS Stream" 2024-03-19T11:47:03.566 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="9" 2024-03-19T11:47:03.566 INFO:teuthology.orchestra.run.smithi191.stdout:ID="centos" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE="rhel fedora" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="9" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:PLATFORM_ID="platform:el9" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:ANSI_COLOR="0;31" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:LOGO="fedora-logo-icon" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://centos.org/" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-19T11:47:03.567 INFO:teuthology.orchestra.run.smithi191.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-19T11:47:03.568 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2024-03-19T11:47:03.590 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:47:03.689 INFO:teuthology.dispatcher.supervisor:Running job 7606466 2024-03-19T11:47:03.689 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606466 --name yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi --description rbd/maintenance/{base/install clusters/{fixed-3 openstack} conf/{disable-pool-app} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_latest} workloads/rebuild_object_map} -- /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606466/orig.config.yaml 2024-03-19T11:47:03.692 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-03-16_15:07:05-rbd-wip-yuri10-testing-2024-03-15-1653-reef-distro-default-smithi/7606466 2024-03-19T11:47:03.693 INFO:teuthology.dispatcher.supervisor:Job PID: 2397836 2024-03-19T11:47:03.693 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-03-19T11:49:03.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:51:03.968 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:53:04.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:55:04.305 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:57:04.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T11:59:04.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:01:04.823 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:03:04.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-19T12:03:05.074 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1