2024-02-21T07:06:24.898 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T07:06:24.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:06:25.074 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc26a52c10>, signals=[15]) 2024-02-21T07:06:25.074 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2024-02-21T07:06:25.074 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2024-02-21T07:06:25.075 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-02-21T07:06:25.101 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging 2024-02-21T07:06:25.101 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server 2024-02-21T07:06:25.101 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-21T07:06:25.125 INFO:teuthology.lock.ops:Start node 'smithi145.front.sepia.ceph.com' reimaging 2024-02-21T07:06:25.126 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: reset os type and version on server 2024-02-21T07:06:25.126 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-21T07:06:25.204 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_centos_9.stream (ID 10) 2024-02-21T07:06:25.236 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_9.stream (ID 10) 2024-02-21T07:06:25.249 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 9.stream 2024-02-21T07:06:25.256 DEBUG:teuthology.provision.fog.smithi145:Requesting image smithi_centos_9.stream (ID 10) 2024-02-21T07:06:25.276 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 9.stream 2024-02-21T07:06:25.306 INFO:teuthology.provision.fog.smithi145:Scheduling deploy of centos 9.stream 2024-02-21T07:06:25.460 INFO:teuthology.orchestra.console.smithi055:Power off 2024-02-21T07:06:25.460 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:06:25.474 INFO:teuthology.orchestra.console.smithi136:Power off 2024-02-21T07:06:25.474 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:06:25.484 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-02-21T07:06:25.485 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:25.495 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-02-21T07:06:25.496 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:25.508 INFO:teuthology.orchestra.console.smithi145:Power off 2024-02-21T07:06:25.508 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T07:06:25.516 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-21T07:06:25.517 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-21T07:06:25.528 DEBUG:teuthology.orchestra.console.smithi145:power off output: Chassis Power Control: Down/Off 2024-02-21T07:06:25.528 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:25.550 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-21T07:06:29.520 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:29.528 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:29.551 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:29.630 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-21T07:06:29.639 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-21T07:06:29.660 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-21T07:06:33.635 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:33.643 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:33.660 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:33.744 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-21T07:06:33.751 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-21T07:06:33.769 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-21T07:06:33.852 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-02-21T07:06:33.953 INFO:teuthology.orchestra.console.smithi136:Power on 2024-02-21T07:06:33.953 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-21T07:06:33.973 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On 2024-02-21T07:06:33.974 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:33.994 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-21T07:06:37.749 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:37.770 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:37.858 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-02-21T07:06:37.877 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-21T07:06:37.960 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-02-21T07:06:37.978 INFO:teuthology.orchestra.console.smithi145:Power off completed 2024-02-21T07:06:37.994 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:38.060 INFO:teuthology.orchestra.console.smithi055:Power on 2024-02-21T07:06:38.061 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-21T07:06:38.079 INFO:teuthology.orchestra.console.smithi145:Power on 2024-02-21T07:06:38.080 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-21T07:06:38.088 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2024-02-21T07:06:38.088 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:38.099 DEBUG:teuthology.orchestra.console.smithi145:power on output: Chassis Power Control: Up/On 2024-02-21T07:06:38.100 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:38.108 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-02-21T07:06:38.110 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-02-21T07:06:38.120 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-21T07:06:42.111 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:42.118 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:42.125 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:42.220 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-02-21T07:06:42.226 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-02-21T07:06:42.233 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is off 2024-02-21T07:06:42.321 INFO:teuthology.orchestra.console.smithi136:Power on completed 2024-02-21T07:06:42.326 INFO:teuthology.orchestra.console.smithi055:Power on completed 2024-02-21T07:06:42.422 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish 2024-02-21T07:06:42.427 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2024-02-21T07:06:46.236 DEBUG:teuthology.orchestra.console.smithi145:pexpect command: ipmitool -H smithi145.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T07:06:46.347 DEBUG:teuthology.orchestra.console.smithi145:check power output: Chassis Power is on 2024-02-21T07:06:46.447 INFO:teuthology.orchestra.console.smithi145:Power on completed 2024-02-21T07:06:46.548 INFO:teuthology.provision.fog.smithi145:Waiting for deploy to finish 2024-02-21T07:09:13.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:13.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:16.380 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:09:16.381 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-02-21T07:09:17.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:20.540 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:09:22.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:22.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:25.436 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:09:25.436 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-02-21T07:09:26.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:29.596 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:09:31.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:31.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:34.492 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:09:34.528 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-02-21T07:09:35.599 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:38.652 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:09:40.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:40.529 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:43.548 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:09:43.580 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-02-21T07:09:44.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:47.708 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:09:49.551 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:49.581 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:52.604 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:09:52.636 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-02-21T07:09:53.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:56.764 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:09:58.608 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:09:58.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:01.664 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:10:02.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:05.820 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:10:07.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:10.748 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-02-21T07:10:11.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:14.876 WARNING:teuthology.provision.fog.smithi145:[Errno None] Unable to connect to port 22 on 172.21.15.145 2024-02-21T07:10:16.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:20.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:10:58.667 WARNING:teuthology.provision.fog.smithi055:timed out 2024-02-21T07:11:04.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:05.027 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-21T07:11:05.028 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-21T07:11:05.361 INFO:teuthology.provision.fog.smithi055:Node is ready 2024-02-21T07:11:05.361 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2024-02-21T07:11:05.376 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2024-02-21T07:11:05.376 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2024-02-21T07:11:05.431 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2024-02-21T07:11:05.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-02-21T07:11:05.546 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2024-02-21T07:11:05.577 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2024-02-21T07:11:05.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2024-02-21T07:11:05.719 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2024-02-21T07:11:05.789 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-02-21T07:11:05.844 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-02-21T07:11:05.844 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-02-21T07:11:05.844 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-02-21T07:11:05.844 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:05.845 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:05.846 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2024-02-21T07:11:05.847 DEBUG:teuthology.parallel:result is None 2024-02-21T07:11:16.758 WARNING:teuthology.provision.fog.smithi136:timed out 2024-02-21T07:11:20.886 WARNING:teuthology.provision.fog.smithi145:timed out 2024-02-21T07:11:22.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:23.052 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-21T07:11:23.053 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-21T07:11:23.352 INFO:teuthology.provision.fog.smithi136:Node is ready 2024-02-21T07:11:23.353 DEBUG:teuthology.orchestra.run.smithi136:> hostname 2024-02-21T07:11:23.367 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com 2024-02-21T07:11:23.367 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts 2024-02-21T07:11:23.422 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136 2024-02-21T07:11:23.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-21T07:11:23.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts 2024-02-21T07:11:23.577 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts 2024-02-21T07:11:23.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname 2024-02-21T07:11:23.711 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136 2024-02-21T07:11:23.777 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-21T07:11:23.831 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-21T07:11:23.831 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:23.832 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:23.833 INFO:teuthology.provision.fog.smithi136:Deploy complete! 2024-02-21T07:11:23.833 DEBUG:teuthology.parallel:result is None 2024-02-21T07:11:26.889 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:27.127 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-21T07:11:27.127 DEBUG:teuthology.orchestra.run.smithi145:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-21T07:11:27.462 INFO:teuthology.provision.fog.smithi145:Node is ready 2024-02-21T07:11:27.463 DEBUG:teuthology.orchestra.run.smithi145:> hostname 2024-02-21T07:11:27.477 INFO:teuthology.orchestra.run.smithi145.stdout:smithi145.front.sepia.ceph.com 2024-02-21T07:11:27.477 DEBUG:teuthology.orchestra.run.smithi145:> grep smithi145.front.sepia.ceph.com /etc/hosts 2024-02-21T07:11:27.532 INFO:teuthology.orchestra.run.smithi145.stdout:172.21.15.145 smithi145.front.sepia.ceph.com smithi145 2024-02-21T07:11:27.532 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-21T07:11:27.655 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hosts 2024-02-21T07:11:27.682 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/172.21.15.145/172.21.15.145/g' /etc/hosts 2024-02-21T07:11:27.749 DEBUG:teuthology.orchestra.run.smithi145:> sudo sed -i -e 's/smithi145.front.sepia.ceph.com/smithi145/g' /etc/hostname 2024-02-21T07:11:27.816 DEBUG:teuthology.orchestra.run.smithi145:> sudo hostname smithi145 2024-02-21T07:11:27.882 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-02-21T07:11:27.936 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:27.937 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:27.937 INFO:teuthology.provision.fog.smithi145:Deploy complete! 2024-02-21T07:11:27.938 DEBUG:teuthology.parallel:result is None 2024-02-21T07:11:28.150 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2024-02-21T07:11:28.150 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-21T07:11:28.180 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com 2024-02-21T07:11:28.180 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-21T07:11:28.196 INFO:teuthology.lock.ops:Checking smithi145.front.sepia.ceph.com 2024-02-21T07:11:28.196 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-21T07:11:28.214 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2024-02-21T07:11:28.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-02-21T07:11:28.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:28.317 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-02-21T07:11:28.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-02-21T07:11:28.503 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-02-21T07:11:28.557 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-02-21T07:11:28.557 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-02-21T07:11:28.612 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:28.613 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:28.614 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-02-21T07:11:28.638 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server 2024-02-21T07:11:28.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-21T07:11:28.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:28.730 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-02-21T07:11:28.808 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-02-21T07:11:28.808 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-02-21T07:11:28.865 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-02-21T07:11:28.865 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:28.922 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:28.923 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:28.923 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-02-21T07:11:28.947 INFO:teuthology.lock.ops:Updating [smithi145.front.sepia.ceph.com]: set os type and version on server 2024-02-21T07:11:28.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-21T07:11:28.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi145.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T07:11:29.041 DEBUG:teuthology.orchestra.run.smithi145:> true 2024-02-21T07:11:29.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi145.front.sepia.ceph.com' 2024-02-21T07:11:29.113 DEBUG:teuthology.orchestra.run.smithi145:> uname -m 2024-02-21T07:11:29.169 INFO:teuthology.orchestra.run.smithi145.stdout:x86_64 2024-02-21T07:11:29.170 DEBUG:teuthology.orchestra.run.smithi145:> cat /etc/os-release 2024-02-21T07:11:29.226 INFO:teuthology.orchestra.run.smithi145.stdout:NAME="CentOS Stream" 2024-02-21T07:11:29.226 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION="9" 2024-02-21T07:11:29.226 INFO:teuthology.orchestra.run.smithi145.stdout:ID="centos" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:ID_LIKE="rhel fedora" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:VERSION_ID="9" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:PLATFORM_ID="platform:el9" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:ANSI_COLOR="0;31" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:LOGO="fedora-logo-icon" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:HOME_URL="https://centos.org/" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-21T07:11:29.227 INFO:teuthology.orchestra.run.smithi145.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T07:11:29.228 INFO:teuthology.lock.ops:Updating smithi145.front.sepia.ceph.com on lock server 2024-02-21T07:11:29.247 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:11:29.340 INFO:teuthology.dispatcher.supervisor:Running job 7569275 2024-02-21T07:11:29.340 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569275 --name vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/fsync-tester}} -- /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569275/orig.config.yaml 2024-02-21T07:11:29.344 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-02-21_06:28:57-fs-wip-vshankar-testing-20240216.060239-testing-default-smithi/7569275 2024-02-21T07:11:29.344 INFO:teuthology.dispatcher.supervisor:Job PID: 102964 2024-02-21T07:11:29.344 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-21T07:13:29.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:15:29.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:17:30.026 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:19:30.093 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:21:30.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:23:30.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:25:30.625 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:27:30.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:29:30.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:31:31.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:33:31.321 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:35:31.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T07:35:31.557 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1