2024-02-19T16:10:31.678 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-19T16:10:31.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:10:31.862 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f11e2132c10>, signals=[15]) 2024-02-19T16:10:31.862 INFO:teuthology.lock.ops:Start node 'smithi119.front.sepia.ceph.com' reimaging 2024-02-19T16:10:31.863 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:10:31.863 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-02-19T16:10:31.883 INFO:teuthology.lock.ops:Start node 'smithi192.front.sepia.ceph.com' reimaging 2024-02-19T16:10:31.883 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:10:31.883 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-02-19T16:10:31.907 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging 2024-02-19T16:10:31.907 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server 2024-02-19T16:10:31.907 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-02-19T16:10:32.017 DEBUG:teuthology.provision.fog.smithi119:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:10:32.025 DEBUG:teuthology.provision.fog.smithi192:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:10:32.041 DEBUG:teuthology.provision.fog.smithi204:Requesting image smithi_centos_9.stream (ID 10) 2024-02-19T16:10:32.063 INFO:teuthology.provision.fog.smithi119:Scheduling deploy of centos 9.stream 2024-02-19T16:10:32.076 INFO:teuthology.provision.fog.smithi192:Scheduling deploy of centos 9.stream 2024-02-19T16:10:32.093 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 9.stream 2024-02-19T16:10:32.372 INFO:teuthology.orchestra.console.smithi119:Power off 2024-02-19T16:10:32.373 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:10:32.388 INFO:teuthology.orchestra.console.smithi192:Power off 2024-02-19T16:10:32.388 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:10:32.402 DEBUG:teuthology.orchestra.console.smithi119:power off output: Chassis Power Control: Down/Off 2024-02-19T16:10:32.402 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:32.414 DEBUG:teuthology.orchestra.console.smithi192:power off output: Chassis Power Control: Down/Off 2024-02-19T16:10:32.414 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:32.423 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-02-19T16:10:32.432 INFO:teuthology.orchestra.console.smithi204:Power off 2024-02-19T16:10:32.432 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-19T16:10:32.441 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-02-19T16:10:32.454 DEBUG:teuthology.orchestra.console.smithi204:power off output: Chassis Power Control: Down/Off 2024-02-19T16:10:32.454 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:32.476 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-19T16:10:36.428 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:36.442 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:36.477 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:36.538 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-02-19T16:10:36.553 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-02-19T16:10:36.590 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-19T16:10:40.543 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:40.554 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:40.590 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:40.652 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-02-19T16:10:40.662 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-02-19T16:10:40.701 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-19T16:10:40.801 INFO:teuthology.orchestra.console.smithi204:Power off completed 2024-02-19T16:10:40.902 INFO:teuthology.orchestra.console.smithi204:Power on 2024-02-19T16:10:40.902 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:10:40.925 DEBUG:teuthology.orchestra.console.smithi204:power on output: Chassis Power Control: Up/On 2024-02-19T16:10:40.926 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:40.947 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-19T16:10:44.656 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:44.665 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:44.767 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-02-19T16:10:44.774 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-19T16:10:44.868 INFO:teuthology.orchestra.console.smithi119:Power off completed 2024-02-19T16:10:44.875 INFO:teuthology.orchestra.console.smithi192:Power off completed 2024-02-19T16:10:44.948 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:44.970 INFO:teuthology.orchestra.console.smithi119:Power on 2024-02-19T16:10:44.970 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:10:44.977 INFO:teuthology.orchestra.console.smithi192:Power on 2024-02-19T16:10:44.977 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-19T16:10:44.991 DEBUG:teuthology.orchestra.console.smithi119:power on output: Chassis Power Control: Up/On 2024-02-19T16:10:44.991 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:45.000 DEBUG:teuthology.orchestra.console.smithi192:power on output: Chassis Power Control: Up/On 2024-02-19T16:10:45.000 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:45.020 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-19T16:10:45.035 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is off 2024-02-19T16:10:45.057 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is off 2024-02-19T16:10:49.025 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:49.037 DEBUG:teuthology.orchestra.console.smithi119:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:49.057 DEBUG:teuthology.orchestra.console.smithi204:pexpect command: ipmitool -H smithi204.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:49.136 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is off 2024-02-19T16:10:49.149 DEBUG:teuthology.orchestra.console.smithi119:check power output: Chassis Power is on 2024-02-19T16:10:49.243 DEBUG:teuthology.orchestra.console.smithi204:check power output: Chassis Power is on 2024-02-19T16:10:49.250 INFO:teuthology.orchestra.console.smithi119:Power on completed 2024-02-19T16:10:49.344 INFO:teuthology.orchestra.console.smithi204:Power on completed 2024-02-19T16:10:49.351 INFO:teuthology.provision.fog.smithi119:Waiting for deploy to finish 2024-02-19T16:10:49.445 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish 2024-02-19T16:10:53.140 DEBUG:teuthology.orchestra.console.smithi192:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-19T16:10:53.252 DEBUG:teuthology.orchestra.console.smithi192:check power output: Chassis Power is on 2024-02-19T16:10:53.352 INFO:teuthology.orchestra.console.smithi192:Power on completed 2024-02-19T16:10:53.453 INFO:teuthology.provision.fog.smithi192:Waiting for deploy to finish 2024-02-19T16:13:24.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:27.740 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:13:33.744 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:35.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:35.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:36.796 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:13:38.812 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:13:38.844 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:13:42.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:44.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:44.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:45.852 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:13:47.868 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:13:47.904 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:13:51.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:53.872 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:53.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:13:54.908 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:13:56.928 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:13:56.956 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:14:00.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:02.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:02.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:03.968 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:14:06.012 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:14:06.012 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:14:09.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:12.015 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:12.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:13.052 WARNING:teuthology.provision.fog.smithi192:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-02-19T16:14:15.072 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:14:15.072 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:14:19.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:21.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:21.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:24.156 WARNING:teuthology.provision.fog.smithi119:[Errno None] Unable to connect to port 22 on 172.21.15.119 2024-02-19T16:14:24.157 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:14:30.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:30.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:14:33.244 WARNING:teuthology.provision.fog.smithi204:[Errno None] Unable to connect to port 22 on 172.21.15.204 2024-02-19T16:14:39.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:19.099 WARNING:teuthology.provision.fog.smithi192:timed out 2024-02-19T16:15:25.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:25.448 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:15:25.448 DEBUG:teuthology.orchestra.run.smithi192:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:15:25.770 INFO:teuthology.provision.fog.smithi192:Node is ready 2024-02-19T16:15:25.770 DEBUG:teuthology.orchestra.run.smithi192:> hostname 2024-02-19T16:15:25.785 INFO:teuthology.orchestra.run.smithi192.stdout:smithi192.front.sepia.ceph.com 2024-02-19T16:15:25.785 DEBUG:teuthology.orchestra.run.smithi192:> grep smithi192.front.sepia.ceph.com /etc/hosts 2024-02-19T16:15:25.840 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.15.192 smithi192.front.sepia.ceph.com smithi192 2024-02-19T16:15:25.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-02-19T16:15:25.946 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hosts 2024-02-19T16:15:25.974 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/172.21.15.192/172.21.15.192/g' /etc/hosts 2024-02-19T16:15:26.042 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i -e 's/smithi192.front.sepia.ceph.com/smithi192/g' /etc/hostname 2024-02-19T16:15:26.109 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname smithi192 2024-02-19T16:15:26.176 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-02-19T16:15:26.230 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-02-19T16:15:26.230 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-02-19T16:15:26.230 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-02-19T16:15:26.230 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:26.230 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:26.231 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:26.232 INFO:teuthology.provision.fog.smithi192:Deploy complete! 2024-02-19T16:15:26.233 DEBUG:teuthology.parallel:result is None 2024-02-19T16:15:30.169 WARNING:teuthology.provision.fog.smithi119:timed out 2024-02-19T16:15:36.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:36.422 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:15:36.422 DEBUG:teuthology.orchestra.run.smithi119:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:15:36.746 INFO:teuthology.provision.fog.smithi119:Node is ready 2024-02-19T16:15:36.747 DEBUG:teuthology.orchestra.run.smithi119:> hostname 2024-02-19T16:15:36.761 INFO:teuthology.orchestra.run.smithi119.stdout:smithi119.front.sepia.ceph.com 2024-02-19T16:15:36.761 DEBUG:teuthology.orchestra.run.smithi119:> grep smithi119.front.sepia.ceph.com /etc/hosts 2024-02-19T16:15:36.816 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.15.119 smithi119.front.sepia.ceph.com smithi119 2024-02-19T16:15:36.816 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-02-19T16:15:36.939 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hosts 2024-02-19T16:15:36.966 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/172.21.15.119/172.21.15.119/g' /etc/hosts 2024-02-19T16:15:37.033 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i -e 's/smithi119.front.sepia.ceph.com/smithi119/g' /etc/hostname 2024-02-19T16:15:37.100 DEBUG:teuthology.orchestra.run.smithi119:> sudo hostname smithi119 2024-02-19T16:15:37.166 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-02-19T16:15:37.220 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-02-19T16:15:37.220 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:37.221 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:37.221 INFO:teuthology.provision.fog.smithi119:Deploy complete! 2024-02-19T16:15:37.222 DEBUG:teuthology.parallel:result is None 2024-02-19T16:15:39.251 WARNING:teuthology.provision.fog.smithi204:timed out 2024-02-19T16:15:45.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:45.597 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-19T16:15:45.597 DEBUG:teuthology.orchestra.run.smithi204:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-19T16:15:45.942 INFO:teuthology.provision.fog.smithi204:Node is ready 2024-02-19T16:15:45.942 DEBUG:teuthology.orchestra.run.smithi204:> hostname 2024-02-19T16:15:45.957 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com 2024-02-19T16:15:45.957 DEBUG:teuthology.orchestra.run.smithi204:> grep smithi204.front.sepia.ceph.com /etc/hosts 2024-02-19T16:15:46.010 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204 2024-02-19T16:15:46.011 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-02-19T16:15:46.139 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hosts 2024-02-19T16:15:46.168 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/172.21.15.204/172.21.15.204/g' /etc/hosts 2024-02-19T16:15:46.234 DEBUG:teuthology.orchestra.run.smithi204:> sudo sed -i -e 's/smithi204.front.sepia.ceph.com/smithi204/g' /etc/hostname 2024-02-19T16:15:46.301 DEBUG:teuthology.orchestra.run.smithi204:> sudo hostname smithi204 2024-02-19T16:15:46.366 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:46.419 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:46.420 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:46.421 INFO:teuthology.provision.fog.smithi204:Deploy complete! 2024-02-19T16:15:46.421 DEBUG:teuthology.parallel:result is None 2024-02-19T16:15:46.629 INFO:teuthology.lock.ops:Checking smithi119.front.sepia.ceph.com 2024-02-19T16:15:46.629 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:15:46.661 INFO:teuthology.lock.ops:Checking smithi192.front.sepia.ceph.com 2024-02-19T16:15:46.661 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:15:46.680 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com 2024-02-19T16:15:46.680 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-19T16:15:46.712 INFO:teuthology.lock.ops:Updating [smithi119.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:15:46.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-02-19T16:15:46.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:46.801 DEBUG:teuthology.orchestra.run.smithi119:> true 2024-02-19T16:15:46.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2024-02-19T16:15:46.873 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2024-02-19T16:15:46.929 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2024-02-19T16:15:46.930 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="CentOS Stream" 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="9" 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:ID="centos" 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="9" 2024-02-19T16:15:46.986 INFO:teuthology.orchestra.run.smithi119.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:46.987 INFO:teuthology.orchestra.run.smithi119.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:46.988 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2024-02-19T16:15:47.011 INFO:teuthology.lock.ops:Updating [smithi192.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:15:47.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-02-19T16:15:47.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:47.101 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-02-19T16:15:47.274 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-02-19T16:15:47.274 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-02-19T16:15:47.329 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-02-19T16:15:47.329 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-02-19T16:15:47.383 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-02-19T16:15:47.383 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:47.384 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:47.385 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-02-19T16:15:47.402 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server 2024-02-19T16:15:47.402 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-19T16:15:47.402 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi204.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-19T16:15:47.506 DEBUG:teuthology.orchestra.run.smithi204:> true 2024-02-19T16:15:47.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi204.front.sepia.ceph.com' 2024-02-19T16:15:47.577 DEBUG:teuthology.orchestra.run.smithi204:> uname -m 2024-02-19T16:15:47.633 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64 2024-02-19T16:15:47.633 DEBUG:teuthology.orchestra.run.smithi204:> cat /etc/os-release 2024-02-19T16:15:47.688 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="9" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="9" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el9" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:LOGO="fedora-logo-icon" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/" 2024-02-19T16:15:47.689 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-19T16:15:47.690 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-19T16:15:47.690 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-19T16:15:47.690 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server 2024-02-19T16:15:47.711 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:15:47.945 INFO:teuthology.dispatcher.supervisor:Running job 7566505 2024-02-19T16:15:47.945 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566505 --name leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/fs/misc}} -- /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566505/orig.config.yaml 2024-02-19T16:15:47.948 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/leonidus-2024-02-19_14:34:49-fs-wip-lusov-qdb-distro-default-smithi/7566505 2024-02-19T16:15:47.948 INFO:teuthology.dispatcher.supervisor:Job PID: 3032544 2024-02-19T16:15:47.948 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-19T16:17:48.049 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:19:48.225 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:21:48.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:23:48.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:25:48.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:27:48.908 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:29:49.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:31:49.230 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-19T16:31:49.288 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1