2024-04-16T16:34:02.556 INFO:root:teuthology version: 0.0.1.dev267+g6c63784
2024-04-16T16:34:02.556 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:34:02.732 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f1cafc28f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f1cb099fc10>, signals=[15])
2024-04-16T16:34:02.733 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging
2024-04-16T16:34:02.733 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T16:34:02.733 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2024-04-16T16:34:02.757 INFO:teuthology.lock.ops:Start node 'smithi104.front.sepia.ceph.com' reimaging
2024-04-16T16:34:02.757 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T16:34:02.757 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-16T16:34:02.781 INFO:teuthology.lock.ops:Start node 'smithi117.front.sepia.ceph.com' reimaging
2024-04-16T16:34:02.781 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: reset os type and version on server
2024-04-16T16:34:02.782 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-16T16:34:02.883 DEBUG:teuthology.provision.fog.smithi045:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T16:34:02.886 DEBUG:teuthology.provision.fog.smithi104:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T16:34:02.901 DEBUG:teuthology.provision.fog.smithi117:Requesting image smithi_centos_9.stream (ID 10)
2024-04-16T16:34:02.921 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 9.stream
2024-04-16T16:34:02.928 INFO:teuthology.provision.fog.smithi104:Scheduling deploy of centos 9.stream
2024-04-16T16:34:02.947 INFO:teuthology.provision.fog.smithi117:Scheduling deploy of centos 9.stream
2024-04-16T16:34:03.005 DEBUG:teuthology.provision.fog.smithi117:Canceling deploy task with ID 964631
2024-04-16T16:34:03.152 INFO:teuthology.orchestra.console.smithi045:Power off
2024-04-16T16:34:03.152 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T16:34:03.173 INFO:teuthology.orchestra.console.smithi104:Power off
2024-04-16T16:34:03.174 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T16:34:03.182 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off
2024-04-16T16:34:03.183 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.197 DEBUG:teuthology.orchestra.console.smithi104:power off output: Chassis Power Control: Down/Off
2024-04-16T16:34:03.198 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.209 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2024-04-16T16:34:03.216 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-16T16:34:03.234 INFO:teuthology.orchestra.console.smithi117:Power off
2024-04-16T16:34:03.234 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-04-16T16:34:03.255 DEBUG:teuthology.orchestra.console.smithi117:power off output: Chassis Power Control: Down/Off
2024-04-16T16:34:03.255 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.274 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-16T16:34:03.311 INFO:teuthology.orchestra.console.smithi045:Power off completed
2024-04-16T16:34:03.317 INFO:teuthology.orchestra.console.smithi104:Power off completed
2024-04-16T16:34:03.376 INFO:teuthology.orchestra.console.smithi117:Power off completed
2024-04-16T16:34:03.412 INFO:teuthology.orchestra.console.smithi045:Power on
2024-04-16T16:34:03.412 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T16:34:03.420 INFO:teuthology.orchestra.console.smithi104:Power on
2024-04-16T16:34:03.420 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T16:34:03.433 DEBUG:teuthology.orchestra.console.smithi045:power on output: Chassis Power Control: Up/On
2024-04-16T16:34:03.433 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.441 DEBUG:teuthology.orchestra.console.smithi104:power on output: Chassis Power Control: Up/On
2024-04-16T16:34:03.442 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.457 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2024-04-16T16:34:03.462 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-16T16:34:03.477 INFO:teuthology.orchestra.console.smithi117:Power on
2024-04-16T16:34:03.477 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-04-16T16:34:03.499 DEBUG:teuthology.orchestra.console.smithi117:power on output: Chassis Power Control: Up/On
2024-04-16T16:34:03.499 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:03.522 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-16T16:34:07.463 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:07.470 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:07.523 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:07.571 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off
2024-04-16T16:34:07.578 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is off
2024-04-16T16:34:07.632 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is off
2024-04-16T16:34:11.576 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:11.584 DEBUG:teuthology.orchestra.console.smithi104:pexpect command: ipmitool -H smithi104.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:11.633 DEBUG:teuthology.orchestra.console.smithi117:pexpect command: ipmitool -H smithi117.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-04-16T16:34:11.686 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on
2024-04-16T16:34:11.742 DEBUG:teuthology.orchestra.console.smithi117:check power output: Chassis Power is on
2024-04-16T16:34:11.787 INFO:teuthology.orchestra.console.smithi045:Power on completed
2024-04-16T16:34:11.799 DEBUG:teuthology.orchestra.console.smithi104:check power output: Chassis Power is on
2024-04-16T16:34:11.842 INFO:teuthology.orchestra.console.smithi117:Power on completed
2024-04-16T16:34:11.888 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish
2024-04-16T16:34:11.900 INFO:teuthology.orchestra.console.smithi104:Power on completed
2024-04-16T16:34:11.944 INFO:teuthology.provision.fog.smithi117:Waiting for deploy to finish
2024-04-16T16:34:12.001 INFO:teuthology.provision.fog.smithi104:Waiting for deploy to finish
2024-04-16T16:36:42.895 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:36:42.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:36:57.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:01.343 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-16T16:37:01.343 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2024-04-16T16:37:07.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:07.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:10.431 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-16T16:37:10.431 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2024-04-16T16:37:16.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:16.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:16.446 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-16T16:37:19.518 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-16T16:37:19.519 WARNING:teuthology.provision.fog.smithi045:[Errno None] Unable to connect to port 22 on 172.21.15.45
2024-04-16T16:37:22.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:25.502 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-16T16:37:25.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:25.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:28.574 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-16T16:37:31.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:31.650 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-16T16:37:34.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:37.630 WARNING:teuthology.provision.fog.smithi104:[Errno None] Unable to connect to port 22 on 172.21.15.104
2024-04-16T16:37:37.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:40.702 WARNING:teuthology.provision.fog.smithi117:[Errno None] Unable to connect to port 22 on 172.21.15.117
2024-04-16T16:37:43.634 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:37:46.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:25.535 WARNING:teuthology.provision.fog.smithi045:timed out
2024-04-16T16:38:31.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:31.781 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T16:38:31.781 DEBUG:teuthology.orchestra.run.smithi045:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T16:38:32.151 INFO:teuthology.provision.fog.smithi045:Node is ready
2024-04-16T16:38:32.151 DEBUG:teuthology.orchestra.run.smithi045:> hostname
2024-04-16T16:38:32.167 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com
2024-04-16T16:38:32.167 DEBUG:teuthology.orchestra.run.smithi045:> grep smithi045.front.sepia.ceph.com /etc/hosts
2024-04-16T16:38:32.223 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045
2024-04-16T16:38:32.223 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2024-04-16T16:38:32.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hosts
2024-04-16T16:38:32.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/172.21.15.45/172.21.15.45/g' /etc/hosts
2024-04-16T16:38:32.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i -e 's/smithi045.front.sepia.ceph.com/smithi045/g' /etc/hostname
2024-04-16T16:38:32.504 DEBUG:teuthology.orchestra.run.smithi045:> sudo hostname smithi045
2024-04-16T16:38:32.574 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:32.628 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:32.629 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:32.629 INFO:teuthology.provision.fog.smithi045:Deploy complete!
2024-04-16T16:38:32.631 DEBUG:teuthology.parallel:result is None
2024-04-16T16:38:43.647 WARNING:teuthology.provision.fog.smithi104:timed out
2024-04-16T16:38:46.712 WARNING:teuthology.provision.fog.smithi117:timed out
2024-04-16T16:38:49.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:49.865 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T16:38:49.866 DEBUG:teuthology.orchestra.run.smithi104:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T16:38:50.204 INFO:teuthology.provision.fog.smithi104:Node is ready
2024-04-16T16:38:50.204 DEBUG:teuthology.orchestra.run.smithi104:> hostname
2024-04-16T16:38:50.223 INFO:teuthology.orchestra.run.smithi104.stdout:smithi104.front.sepia.ceph.com
2024-04-16T16:38:50.223 DEBUG:teuthology.orchestra.run.smithi104:> grep smithi104.front.sepia.ceph.com /etc/hosts
2024-04-16T16:38:50.283 INFO:teuthology.orchestra.run.smithi104.stdout:172.21.15.104 smithi104.front.sepia.ceph.com smithi104
2024-04-16T16:38:50.283 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-16T16:38:50.416 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hosts
2024-04-16T16:38:50.445 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/172.21.15.104/172.21.15.104/g' /etc/hosts
2024-04-16T16:38:50.516 DEBUG:teuthology.orchestra.run.smithi104:> sudo sed -i -e 's/smithi104.front.sepia.ceph.com/smithi104/g' /etc/hostname
2024-04-16T16:38:50.587 DEBUG:teuthology.orchestra.run.smithi104:> sudo hostname smithi104
2024-04-16T16:38:50.657 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:50.715 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:50.716 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:50.716 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:50.716 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:50.716 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:50.716 INFO:teuthology.provision.fog.smithi104:Deploy complete!
2024-04-16T16:38:50.717 DEBUG:teuthology.parallel:result is None
2024-04-16T16:38:52.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:52.961 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-04-16T16:38:52.962 DEBUG:teuthology.orchestra.run.smithi117:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-04-16T16:38:53.303 INFO:teuthology.provision.fog.smithi117:Node is ready
2024-04-16T16:38:53.303 DEBUG:teuthology.orchestra.run.smithi117:> hostname
2024-04-16T16:38:53.317 INFO:teuthology.orchestra.run.smithi117.stdout:smithi117.front.sepia.ceph.com
2024-04-16T16:38:53.318 DEBUG:teuthology.orchestra.run.smithi117:> grep smithi117.front.sepia.ceph.com /etc/hosts
2024-04-16T16:38:53.373 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.15.117 smithi117.front.sepia.ceph.com smithi117
2024-04-16T16:38:53.373 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-16T16:38:53.465 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hosts
2024-04-16T16:38:53.493 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/172.21.15.117/172.21.15.117/g' /etc/hosts
2024-04-16T16:38:53.560 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i -e 's/smithi117.front.sepia.ceph.com/smithi117/g' /etc/hostname
2024-04-16T16:38:53.628 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname smithi117
2024-04-16T16:38:53.694 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-16T16:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-04-16T16:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-04-16T16:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-04-16T16:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:53.748 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:53.749 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:53.749 INFO:teuthology.provision.fog.smithi117:Deploy complete!
2024-04-16T16:38:53.750 DEBUG:teuthology.parallel:result is None
2024-04-16T16:38:53.958 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com
2024-04-16T16:38:53.959 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T16:38:53.987 INFO:teuthology.lock.ops:Checking smithi104.front.sepia.ceph.com
2024-04-16T16:38:53.987 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T16:38:54.003 INFO:teuthology.lock.ops:Checking smithi117.front.sepia.ceph.com
2024-04-16T16:38:54.003 INFO:teuthology.lock.ops:New key found. Updating...
2024-04-16T16:38:54.021 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server
2024-04-16T16:38:54.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com'
2024-04-16T16:38:54.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:54.122 DEBUG:teuthology.orchestra.run.smithi045:> true
2024-04-16T16:38:54.304 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com'
2024-04-16T16:38:54.304 DEBUG:teuthology.orchestra.run.smithi045:> uname -m
2024-04-16T16:38:54.359 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64
2024-04-16T16:38:54.360 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release
2024-04-16T16:38:54.414 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:54.415 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:54.416 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server
2024-04-16T16:38:54.437 INFO:teuthology.lock.ops:Updating [smithi104.front.sepia.ceph.com]: set os type and version on server
2024-04-16T16:38:54.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-16T16:38:54.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:54.522 DEBUG:teuthology.orchestra.run.smithi104:> true
2024-04-16T16:38:54.598 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi104.front.sepia.ceph.com'
2024-04-16T16:38:54.598 DEBUG:teuthology.orchestra.run.smithi104:> uname -m
2024-04-16T16:38:54.655 INFO:teuthology.orchestra.run.smithi104.stdout:x86_64
2024-04-16T16:38:54.655 DEBUG:teuthology.orchestra.run.smithi104:> cat /etc/os-release
2024-04-16T16:38:54.711 INFO:teuthology.orchestra.run.smithi104.stdout:NAME="CentOS Stream"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION="9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:ID="centos"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:VERSION_ID="9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:54.712 INFO:teuthology.orchestra.run.smithi104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:54.713 INFO:teuthology.lock.ops:Updating smithi104.front.sepia.ceph.com on lock server
2024-04-16T16:38:54.737 INFO:teuthology.lock.ops:Updating [smithi117.front.sepia.ceph.com]: set os type and version on server
2024-04-16T16:38:54.737 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-16T16:38:54.738 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-04-16T16:38:54.824 DEBUG:teuthology.orchestra.run.smithi117:> true
2024-04-16T16:38:54.889 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com'
2024-04-16T16:38:54.889 DEBUG:teuthology.orchestra.run.smithi117:> uname -m
2024-04-16T16:38:54.944 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64
2024-04-16T16:38:54.944 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31"
2024-04-16T16:38:54.999 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon"
2024-04-16T16:38:55.000 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-04-16T16:38:55.000 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/"
2024-04-16T16:38:55.000 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-04-16T16:38:55.000 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-04-16T16:38:55.000 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-04-16T16:38:55.000 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server
2024-04-16T16:38:55.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:38:55.135 INFO:teuthology.dispatcher.supervisor:Running job 7658439
2024-04-16T16:38:55.135 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/virtualenv/bin/teuthology -v --owner scheduled_mchangir@teuthology --archive /home/teuthworker/archive/mchangir-2024-04-16_16:32:10-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658439 --name mchangir-2024-04-16_16:32:10-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} -- /home/teuthworker/archive/mchangir-2024-04-16_16:32:10-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658439/orig.config.yaml
2024-04-16T16:38:55.138 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/mchangir-2024-04-16_16:32:10-fs-wip-mchangir-qa-debug-resource-temporarily-unavailable-issue-distro-default-smithi/7658439
2024-04-16T16:38:55.138 INFO:teuthology.dispatcher.supervisor:Job PID: 852515
2024-04-16T16:38:55.138 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-04-16T16:40:55.228 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:42:55.392 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:44:55.471 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:46:55.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:48:55.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:50:55.980 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:52:56.104 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:54:56.284 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:56:56.449 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T16:58:56.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:00:56.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:02:56.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:04:57.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:06:57.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:08:57.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:10:57.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:12:57.774 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:14:57.955 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:16:58.127 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:18:58.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:20:58.437 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:22:58.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-04-16T17:22:58.606 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1