2023-11-09T12:31:50.895 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-09T12:31:50.896 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:31:51.023 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7ff3ca0cbb20>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7ff3c9d78b80>, signals=[15])
2023-11-09T12:31:51.024 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging
2023-11-09T12:31:51.024 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T12:31:51.025 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-09T12:31:51.043 INFO:teuthology.lock.ops:Start node 'smithi164.front.sepia.ceph.com' reimaging
2023-11-09T12:31:51.043 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: reset os type and version on server
2023-11-09T12:31:51.043 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-11-09T12:31:51.045 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"}
2023-11-09T12:31:51.067 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /host {"name": "smithi164"}
2023-11-09T12:31:51.114 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-09T12:31:51.125 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-11-09T12:31:51.150 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_9.stream (ID 10)
2023-11-09T12:31:51.151 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 10}
2023-11-09T12:31:51.167 DEBUG:teuthology.provision.fog.smithi164:Requesting image smithi_centos_9.stream (ID 10)
2023-11-09T12:31:51.167 DEBUG:teuthology.provision.fog.smithi164:FOG request: PUT /host/269 {"imageID": 10}
2023-11-09T12:31:51.206 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 9.stream
2023-11-09T12:31:51.206 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:31:51.209 INFO:teuthology.provision.fog.smithi164:Scheduling deploy of centos 9.stream
2023-11-09T12:31:51.209 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:31:51.275 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T12:31:51.279 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"}
2023-11-09T12:31:51.317 DEBUG:teuthology.provision.fog.smithi164:FOG request: POST /host/269/task {"taskTypeID": 1}
2023-11-09T12:31:51.320 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1}
2023-11-09T12:31:51.390 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:31:51.394 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:31:51.481 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-09T12:31:51.482 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T12:31:51.494 INFO:teuthology.orchestra.console.smithi164:Power off
2023-11-09T12:31:51.495 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T12:31:51.504 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-09T12:31:51.504 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:51.514 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-11-09T12:31:51.515 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:51.527 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-09T12:31:51.536 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-11-09T12:31:55.528 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:55.538 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:55.637 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-09T12:31:55.646 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-11-09T12:31:59.642 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:59.651 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:31:59.753 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-09T12:31:59.761 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-11-09T12:32:03.758 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:03.766 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:03.868 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-09T12:32:03.873 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-09T12:32:03.969 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-09T12:32:03.975 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-11-09T12:32:04.070 INFO:teuthology.orchestra.console.smithi159:Power on
2023-11-09T12:32:04.071 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T12:32:04.079 INFO:teuthology.orchestra.console.smithi164:Power on
2023-11-09T12:32:04.079 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-09T12:32:04.093 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On
2023-11-09T12:32:04.094 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:04.103 DEBUG:teuthology.orchestra.console.smithi164:power on output: Chassis Power Control: Up/On
2023-11-09T12:32:04.103 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:04.119 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-09T12:32:04.126 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-09T12:32:08.124 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:08.130 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:08.233 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-09T12:32:08.238 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on
2023-11-09T12:32:08.338 INFO:teuthology.orchestra.console.smithi164:Power on completed
2023-11-09T12:32:08.439 INFO:teuthology.provision.fog.smithi164:Waiting for deploy to finish
2023-11-09T12:32:08.440 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:32:12.238 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T12:32:12.351 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on
2023-11-09T12:32:12.452 INFO:teuthology.orchestra.console.smithi159:Power on completed
2023-11-09T12:32:12.554 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish
2023-11-09T12:32:12.554 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:32:23.511 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:32:27.633 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:32:38.592 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:32:42.708 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:32:53.665 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:32:57.784 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:33:08.737 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:33:12.852 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:33:23.803 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:33:27.930 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:33:38.882 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:33:43.000 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:33:53.954 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:33:58.076 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:34:09.022 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:34:13.148 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:34:24.083 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:34:28.212 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:34:39.142 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:34:43.276 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:34:54.212 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:34:58.340 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:35:09.289 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:35:13.397 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:35:24.718 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:35:28.465 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:35:39.786 DEBUG:teuthology.provision.fog.smithi164:FOG request: GET /task/active None
2023-11-09T12:35:39.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:35:42.907 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:35:43.537 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None
2023-11-09T12:35:43.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:35:46.682 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:35:48.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:35:51.962 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:35:52.684 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:35:55.738 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:35:57.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:01.018 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:36:01.741 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:04.794 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:36:07.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:10.074 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:36:10.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:13.850 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:36:16.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:19.130 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:36:19.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:22.906 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:36:25.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:28.186 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:36:28.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:31.962 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:36:34.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:37.242 WARNING:teuthology.provision.fog.smithi164:[Errno None] Unable to connect to port 22 on 172.21.15.164
2023-11-09T12:36:37.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:41.018 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159
2023-11-09T12:36:43.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:36:47.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:37:43.291 WARNING:teuthology.provision.fog.smithi164:timed out
2023-11-09T12:37:47.031 WARNING:teuthology.provision.fog.smithi159:timed out
2023-11-09T12:37:49.297 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:37:49.534 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T12:37:49.536 DEBUG:teuthology.orchestra.run.smithi164:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T12:37:49.895 INFO:teuthology.provision.fog.smithi164:Node is ready
2023-11-09T12:37:49.896 DEBUG:teuthology.orchestra.run.smithi164:> hostname
2023-11-09T12:37:49.911 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164.front.sepia.ceph.com
2023-11-09T12:37:49.912 DEBUG:teuthology.orchestra.run.smithi164:> grep smithi164.front.sepia.ceph.com /etc/hosts
2023-11-09T12:37:49.966 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164 smithi164.front.sepia.ceph.com smithi164
2023-11-09T12:37:49.967 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-11-09T12:37:50.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hosts
2023-11-09T12:37:50.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/172.21.15.164/172.21.15.164/g' /etc/hosts
2023-11-09T12:37:50.173 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i -e 's/smithi164.front.sepia.ceph.com/smithi164/g' /etc/hostname
2023-11-09T12:37:50.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname smithi164
2023-11-09T12:37:50.307 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-11-09T12:37:50.362 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-11-09T12:37:50.363 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2023-11-09T12:37:50.363 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-11-09T12:37:50.363 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-11-09T12:37:50.363 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2023-11-09T12:37:50.363 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2023-11-09T12:37:50.364 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-09T12:37:50.364 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-11-09T12:37:50.364 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2023-11-09T12:37:50.364 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-09T12:37:50.365 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-11-09T12:37:50.365 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T12:37:50.365 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-09T12:37:50.365 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T12:37:50.366 INFO:teuthology.provision.fog.smithi164:Deploy complete!
2023-11-09T12:37:50.368 DEBUG:teuthology.parallel:result is None
2023-11-09T12:37:53.036 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:37:53.266 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-09T12:37:53.266 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-09T12:37:53.626 INFO:teuthology.provision.fog.smithi159:Node is ready
2023-11-09T12:37:53.626 DEBUG:teuthology.orchestra.run.smithi159:> hostname
2023-11-09T12:37:53.643 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com
2023-11-09T12:37:53.643 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts
2023-11-09T12:37:53.699 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159
2023-11-09T12:37:53.699 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-09T12:37:53.805 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts
2023-11-09T12:37:53.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts
2023-11-09T12:37:53.903 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname
2023-11-09T12:37:53.972 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159
2023-11-09T12:37:54.040 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-09T12:37:54.096 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-11-09T12:37:54.096 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9"
2023-11-09T12:37:54.097 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-11-09T12:37:54.097 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-11-09T12:37:54.097 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9"
2023-11-09T12:37:54.097 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9"
2023-11-09T12:37:54.098 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-09T12:37:54.098 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-09T12:37:54.098 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon"
2023-11-09T12:37:54.099 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-09T12:37:54.099 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-11-09T12:37:54.099 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T12:37:54.099 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-09T12:37:54.100 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T12:37:54.100 INFO:teuthology.provision.fog.smithi159:Deploy complete!
2023-11-09T12:37:54.101 DEBUG:teuthology.parallel:result is None
2023-11-09T12:37:54.266 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com
2023-11-09T12:37:54.267 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T12:37:54.292 INFO:teuthology.lock.ops:Checking smithi164.front.sepia.ceph.com
2023-11-09T12:37:54.293 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-09T12:37:54.310 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server
2023-11-09T12:37:54.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-09T12:37:54.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:37:54.392 DEBUG:teuthology.orchestra.run.smithi159:> true
2023-11-09T12:37:54.456 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com'
2023-11-09T12:37:54.456 DEBUG:teuthology.orchestra.run.smithi159:> uname -m
2023-11-09T12:37:54.510 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64
2023-11-09T12:37:54.510 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release
2023-11-09T12:37:54.564 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream"
2023-11-09T12:37:54.564 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9"
2023-11-09T12:37:54.564 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos"
2023-11-09T12:37:54.564 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora"
2023-11-09T12:37:54.565 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9"
2023-11-09T12:37:54.565 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9"
2023-11-09T12:37:54.565 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-09T12:37:54.565 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31"
2023-11-09T12:37:54.565 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon"
2023-11-09T12:37:54.566 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-09T12:37:54.566 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/"
2023-11-09T12:37:54.566 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T12:37:54.566 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-09T12:37:54.566 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T12:37:54.567 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server
2023-11-09T12:37:54.592 INFO:teuthology.lock.ops:Updating [smithi164.front.sepia.ceph.com]: set os type and version on server
2023-11-09T12:37:54.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-11-09T12:37:54.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-09T12:37:54.676 DEBUG:teuthology.orchestra.run.smithi164:> true
2023-11-09T12:37:54.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com'
2023-11-09T12:37:54.747 DEBUG:teuthology.orchestra.run.smithi164:> uname -m
2023-11-09T12:37:54.803 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64
2023-11-09T12:37:54.803 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release
2023-11-09T12:37:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream"
2023-11-09T12:37:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9"
2023-11-09T12:37:54.859 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos"
2023-11-09T12:37:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora"
2023-11-09T12:37:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9"
2023-11-09T12:37:54.860 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9"
2023-11-09T12:37:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9"
2023-11-09T12:37:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31"
2023-11-09T12:37:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon"
2023-11-09T12:37:54.861 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-11-09T12:37:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/"
2023-11-09T12:37:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-09T12:37:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-11-09T12:37:54.862 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-09T12:37:54.863 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server
2023-11-09T12:37:54.884 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:37:55.124 INFO:teuthology.dispatcher.supervisor:Running job 7452746
2023-11-09T12:37:55.124 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi/7452746 --name nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi --description rados:thrash-dedup/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/dedup-io-mixed} -- /home/teuthworker/archive/nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi/7452746/orig.config.yaml
2023-11-09T12:37:55.127 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi/7452746
2023-11-09T12:37:55.128 INFO:teuthology.dispatcher.supervisor:Job PID: 3971338
2023-11-09T12:37:55.128 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-09T12:39:55.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:41:55.306 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:43:55.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:45:55.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:47:55.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:49:55.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:51:56.028 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:53:56.182 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:55:56.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:57:56.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T12:59:56.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T13:01:56.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T13:03:56.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T13:05:57.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T13:07:57.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-09T13:07:57.299 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-09T13:07:57.426 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-09T13:07:57.426 INFO:teuthology.nuke:Checking targets against current locks
2023-11-09T13:07:57.476 DEBUG:teuthology.nuke:shortname: smithi159
2023-11-09T13:07:57.477 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T13:07:57.496 DEBUG:teuthology.nuke:shortname: smithi164
2023-11-09T13:07:57.497 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-09T13:07:57.500 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi/7452746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 12:31:50.056639', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFUuH/NO6MIRUpXe7xm/fF5LR4wGk+aN8hM8lPvXoi92mKJgscq0/s1xxMmbojv9BlFoac802suTZVRo3bWVcQA='}
2023-11-09T13:07:57.526 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/nmordech-2023-11-09_12:31:00-rados:thrash-dedup-main-distro-default-smithi/7452746', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-09 12:31:50.054786', 'locked_by': 'scheduled_nmordech@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDshqCLgL1RGnkRv8hRDg/gMD+M+zaRG3X2GyXGlUbL/q23UvGh4eP+QlbFPkKZmFzZm03WhpumBX522d+8oLFw='}
2023-11-09T13:07:57.550 INFO:teuthology.orchestra.console.smithi159:Power off
2023-11-09T13:07:57.550 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T13:07:57.576 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off
2023-11-09T13:07:57.576 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T13:07:57.591 INFO:teuthology.orchestra.console.smithi164:Power off
2023-11-09T13:07:57.592 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-09T13:07:57.602 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off
2023-11-09T13:07:57.616 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off
2023-11-09T13:07:57.616 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-09T13:07:57.641 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off
2023-11-09T13:07:57.704 INFO:teuthology.orchestra.console.smithi159:Power off completed
2023-11-09T13:07:57.743 INFO:teuthology.orchestra.console.smithi164:Power off completed
2023-11-09T13:07:57.867 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com
2023-11-09T13:07:57.889 INFO:teuthology.lock.ops:unlocked: smithi164.front.sepia.ceph.com