2024-04-12T19:22:35.737 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-12T19:22:35.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:22:35.920 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7fab20fb0f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7fab21fe7c10>, signals=[15])
2024-04-12T19:22:35.921 INFO:teuthology.lock.ops:Start node 'smithi017.front.sepia.ceph.com' reimaging
2024-04-12T19:22:35.921 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T19:22:35.921 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-12T19:22:35.938 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging
2024-04-12T19:22:35.938 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T19:22:35.938 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-04-12T19:22:35.962 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging
2024-04-12T19:22:35.962 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server
2024-04-12T19:22:35.963 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-12T19:22:36.064 DEBUG:teuthology.provision.fog.smithi017:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T19:22:36.081 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T19:22:36.110 INFO:teuthology.provision.fog.smithi017:Scheduling deploy of centos 9.stream
2024-04-12T19:22:36.135 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 9.stream
2024-04-12T19:22:36.138 DEBUG:teuthology.provision.fog.smithi156:Requesting image smithi_centos_9.stream (ID 10)
2024-04-12T19:22:36.179 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 9.stream
2024-04-12T19:22:36.339 INFO:teuthology.orchestra.console.smithi026:Power off
2024-04-12T19:22:36.339 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T19:22:36.352 INFO:teuthology.orchestra.console.smithi017:Power off
2024-04-12T19:22:36.352 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T19:22:36.365 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off
2024-04-12T19:22:36.366 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:36.374 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off
2024-04-12T19:22:36.374 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:36.393 INFO:teuthology.orchestra.console.smithi156:Power off
2024-04-12T19:22:36.393 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-12T19:22:36.400 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-04-12T19:22:36.400 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-12T19:22:36.414 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off
2024-04-12T19:22:36.415 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:36.440 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-12T19:22:36.501 INFO:teuthology.orchestra.console.smithi017:Power off completed
2024-04-12T19:22:36.601 INFO:teuthology.orchestra.console.smithi017:Power on
2024-04-12T19:22:36.601 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T19:22:36.624 DEBUG:teuthology.orchestra.console.smithi017:power on output: Chassis Power Control: Up/On
2024-04-12T19:22:36.624 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:36.659 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off
2024-04-12T19:22:40.402 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:40.441 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:40.512 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-04-12T19:22:40.550 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-12T19:22:40.660 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:40.768 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on
2024-04-12T19:22:40.869 INFO:teuthology.orchestra.console.smithi017:Power on completed
2024-04-12T19:22:40.969 INFO:teuthology.provision.fog.smithi017:Waiting for deploy to finish
2024-04-12T19:22:44.515 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:44.551 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:44.626 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-04-12T19:22:44.660 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-12T19:22:44.760 INFO:teuthology.orchestra.console.smithi156:Power off completed
2024-04-12T19:22:44.861 INFO:teuthology.orchestra.console.smithi156:Power on
2024-04-12T19:22:44.861 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T19:22:44.882 DEBUG:teuthology.orchestra.console.smithi156:power on output: Chassis Power Control: Up/On
2024-04-12T19:22:44.882 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:44.903 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-12T19:22:48.630 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:48.740 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-04-12T19:22:48.841 INFO:teuthology.orchestra.console.smithi026:Power off completed
2024-04-12T19:22:48.904 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:48.942 INFO:teuthology.orchestra.console.smithi026:Power on
2024-04-12T19:22:48.943 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-12T19:22:48.967 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On
2024-04-12T19:22:48.968 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:48.996 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off
2024-04-12T19:22:49.014 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off
2024-04-12T19:22:53.001 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:53.015 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-12T19:22:53.111 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on
2024-04-12T19:22:53.167 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on
2024-04-12T19:22:53.213 INFO:teuthology.orchestra.console.smithi026:Power on completed
2024-04-12T19:22:53.268 INFO:teuthology.orchestra.console.smithi156:Power on completed
2024-04-12T19:22:53.314 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish
2024-04-12T19:22:53.369 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish
2024-04-12T19:25:08.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:11.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:12.062 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-12T19:25:14.718 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-12T19:25:18.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:20.723 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:21.118 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-12T19:25:23.774 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-12T19:25:27.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:29.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:30.174 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-12T19:25:32.830 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-12T19:25:36.179 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:38.834 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:39.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:39.230 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-12T19:25:41.886 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-12T19:25:42.210 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:25:45.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:47.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:48.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:48.290 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26
2024-04-12T19:25:50.942 WARNING:teuthology.provision.fog.smithi017:[Errno None] Unable to connect to port 22 on 172.21.15.17
2024-04-12T19:25:51.262 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:25:54.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:56.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:25:57.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:26:00.322 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:26:06.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:26:09.410 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:26:15.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:26:18.494 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:26:24.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:26:27.557 WARNING:teuthology.provision.fog.smithi156:[Errno None] Unable to connect to port 22 on 172.21.15.156
2024-04-12T19:26:33.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:26:54.315 WARNING:teuthology.provision.fog.smithi026:timed out
2024-04-12T19:26:56.951 WARNING:teuthology.provision.fog.smithi017:timed out
2024-04-12T19:27:00.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:00.658 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T19:27:00.658 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T19:27:00.991 INFO:teuthology.provision.fog.smithi026:Node is ready
2024-04-12T19:27:00.991 DEBUG:teuthology.orchestra.run.smithi026:> hostname
2024-04-12T19:27:01.006 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com
2024-04-12T19:27:01.006 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts
2024-04-12T19:27:01.062 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026
2024-04-12T19:27:01.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-04-12T19:27:01.172 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts
2024-04-12T19:27:01.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts
2024-04-12T19:27:01.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname
2024-04-12T19:27:01.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026
2024-04-12T19:27:01.417 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-04-12T19:27:01.472 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:01.474 INFO:teuthology.provision.fog.smithi026:Deploy complete!
2024-04-12T19:27:01.476 DEBUG:teuthology.parallel:result is None
2024-04-12T19:27:02.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:03.186 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T19:27:03.186 DEBUG:teuthology.orchestra.run.smithi017:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T19:27:03.550 INFO:teuthology.provision.fog.smithi017:Node is ready
2024-04-12T19:27:03.550 DEBUG:teuthology.orchestra.run.smithi017:> hostname
2024-04-12T19:27:03.565 INFO:teuthology.orchestra.run.smithi017.stdout:smithi017.front.sepia.ceph.com
2024-04-12T19:27:03.565 DEBUG:teuthology.orchestra.run.smithi017:> grep smithi017.front.sepia.ceph.com /etc/hosts
2024-04-12T19:27:03.621 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.15.17 smithi017.front.sepia.ceph.com smithi017
2024-04-12T19:27:03.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-12T19:27:03.738 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hosts
2024-04-12T19:27:03.770 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/172.21.15.17/172.21.15.17/g' /etc/hosts
2024-04-12T19:27:03.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i -e 's/smithi017.front.sepia.ceph.com/smithi017/g' /etc/hostname
2024-04-12T19:27:03.912 DEBUG:teuthology.orchestra.run.smithi017:> sudo hostname smithi017
2024-04-12T19:27:03.982 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:04.038 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:04.039 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:04.039 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:04.039 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:04.039 INFO:teuthology.provision.fog.smithi017:Deploy complete!
2024-04-12T19:27:04.039 DEBUG:teuthology.parallel:result is None
2024-04-12T19:27:33.571 WARNING:teuthology.provision.fog.smithi156:timed out
2024-04-12T19:27:39.579 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:39.824 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-12T19:27:39.824 DEBUG:teuthology.orchestra.run.smithi156:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-12T19:27:40.137 INFO:teuthology.provision.fog.smithi156:Node is ready
2024-04-12T19:27:40.138 DEBUG:teuthology.orchestra.run.smithi156:> hostname
2024-04-12T19:27:40.153 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com
2024-04-12T19:27:40.153 DEBUG:teuthology.orchestra.run.smithi156:> grep smithi156.front.sepia.ceph.com /etc/hosts
2024-04-12T19:27:40.209 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156
2024-04-12T19:27:40.209 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-12T19:27:40.326 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hosts
2024-04-12T19:27:40.354 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/172.21.15.156/172.21.15.156/g' /etc/hosts
2024-04-12T19:27:40.422 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i -e 's/smithi156.front.sepia.ceph.com/smithi156/g' /etc/hostname
2024-04-12T19:27:40.489 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname smithi156
2024-04-12T19:27:40.556 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:40.611 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:40.612 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:40.612 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:40.612 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:40.612 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:40.612 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:40.612 INFO:teuthology.provision.fog.smithi156:Deploy complete!
2024-04-12T19:27:40.613 DEBUG:teuthology.parallel:result is None
2024-04-12T19:27:40.839 INFO:teuthology.lock.ops:Checking smithi017.front.sepia.ceph.com
2024-04-12T19:27:40.839 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T19:27:40.869 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com
2024-04-12T19:27:40.869 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T19:27:40.894 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com
2024-04-12T19:27:40.894 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-12T19:27:40.920 INFO:teuthology.lock.ops:Updating [smithi017.front.sepia.ceph.com]: set os type and version on server
2024-04-12T19:27:40.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-04-12T19:27:40.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:41.023 DEBUG:teuthology.orchestra.run.smithi017:> true
2024-04-12T19:27:41.204 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com'
2024-04-12T19:27:41.205 DEBUG:teuthology.orchestra.run.smithi017:> uname -m
2024-04-12T19:27:41.259 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64
2024-04-12T19:27:41.259 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release
2024-04-12T19:27:41.314 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:41.315 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:41.316 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:41.316 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server
2024-04-12T19:27:41.335 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server
2024-04-12T19:27:41.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-04-12T19:27:41.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:41.436 DEBUG:teuthology.orchestra.run.smithi026:> true
2024-04-12T19:27:41.624 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com'
2024-04-12T19:27:41.624 DEBUG:teuthology.orchestra.run.smithi026:> uname -m
2024-04-12T19:27:41.679 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64
2024-04-12T19:27:41.679 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="9"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="9"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:41.737 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:41.737 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:41.737 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:41.737 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:41.737 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:41.737 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server
2024-04-12T19:27:41.777 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server
2024-04-12T19:27:41.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-12T19:27:41.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-12T19:27:41.868 DEBUG:teuthology.orchestra.run.smithi156:> true
2024-04-12T19:27:41.943 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com'
2024-04-12T19:27:41.943 DEBUG:teuthology.orchestra.run.smithi156:> uname -m
2024-04-12T19:27:41.999 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64
2024-04-12T19:27:42.000 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release
2024-04-12T19:27:42.055 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream"
2024-04-12T19:27:42.055 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="9"
2024-04-12T19:27:42.055 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="9"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el9"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:LOGO="fedora-logo-icon"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-12T19:27:42.056 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-12T19:27:42.057 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server
2024-04-12T19:27:42.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:27:42.177 INFO:teuthology.dispatcher.supervisor:Running job 7653527
2024-04-12T19:27:42.177 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653527 --name vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-workunit/suites/ffsb}} -- /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653527/orig.config.yaml
2024-04-12T19:27:42.180 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653527
2024-04-12T19:27:42.180 INFO:teuthology.dispatcher.supervisor:Job PID: 117009
2024-04-12T19:27:42.181 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-12T19:29:42.279 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:31:42.445 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:33:42.607 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:35:42.767 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:37:42.929 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:39:43.092 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:41:43.261 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:43:43.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:45:43.576 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:47:43.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:49:43.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:51:44.105 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:53:44.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:55:44.451 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:57:44.624 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T19:59:44.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:01:44.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:03:45.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:05:45.281 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:07:45.433 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:09:45.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:11:45.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:13:45.928 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:15:46.099 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:17:46.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:19:46.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:21:46.659 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:23:46.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:25:46.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:27:47.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:29:47.330 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:31:47.503 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:33:47.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:35:47.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:37:48.035 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:39:48.206 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-12T20:39:48.279 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1