2023-08-10T03:25:20.981 INFO:root:teuthology version: 0.0.1.dev181+g7fda959
2023-08-10T03:25:20.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:25:21.140 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2599f75850>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2599894f70>, signals=[15])
2023-08-10T03:25:21.142 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2023-08-10T03:25:21.143 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2023-08-10T03:25:21.143 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-08-10T03:25:21.166 INFO:teuthology.lock.ops:Start node 'smithi120.front.sepia.ceph.com' reimaging
2023-08-10T03:25:21.167 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: reset os type and version on server
2023-08-10T03:25:21.167 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-08-10T03:25:21.168 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"}
2023-08-10T03:25:21.191 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /host {"name": "smithi120"}
2023-08-10T03:25:21.247 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-10T03:25:21.258 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-08-10T03:25:21.290 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3)
2023-08-10T03:25:21.290 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 3}
2023-08-10T03:25:21.297 DEBUG:teuthology.provision.fog.smithi120:Requesting image smithi_centos_8.stream (ID 3)
2023-08-10T03:25:21.297 DEBUG:teuthology.provision.fog.smithi120:FOG request: PUT /host/225 {"imageID": 3}
2023-08-10T03:25:21.330 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream
2023-08-10T03:25:21.331 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:25:21.335 INFO:teuthology.provision.fog.smithi120:Scheduling deploy of centos 8.stream
2023-08-10T03:25:21.335 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:25:21.395 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /tasktype {"name": "deploy"}
2023-08-10T03:25:21.403 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"}
2023-08-10T03:25:21.433 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1}
2023-08-10T03:25:21.437 DEBUG:teuthology.provision.fog.smithi120:FOG request: POST /host/225/task {"taskTypeID": 1}
2023-08-10T03:25:21.485 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:25:21.489 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:25:21.582 INFO:teuthology.orchestra.console.smithi096:Power off
2023-08-10T03:25:21.582 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T03:25:21.596 INFO:teuthology.orchestra.console.smithi120:Power off
2023-08-10T03:25:21.597 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T03:25:21.606 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off
2023-08-10T03:25:21.608 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:21.620 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-08-10T03:25:21.620 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:21.632 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2023-08-10T03:25:21.641 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-08-10T03:25:21.734 INFO:teuthology.orchestra.console.smithi096:Power off completed
2023-08-10T03:25:21.742 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-08-10T03:25:21.835 INFO:teuthology.orchestra.console.smithi096:Power on
2023-08-10T03:25:21.835 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-10T03:25:21.844 INFO:teuthology.orchestra.console.smithi120:Power on
2023-08-10T03:25:21.845 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-08-10T03:25:21.856 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On
2023-08-10T03:25:21.857 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:21.868 DEBUG:teuthology.orchestra.console.smithi120:power on output: Chassis Power Control: Up/On
2023-08-10T03:25:21.869 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:21.881 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2023-08-10T03:25:21.890 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-08-10T03:25:25.884 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:25.893 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:25.995 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2023-08-10T03:25:26.004 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-08-10T03:25:26.096 INFO:teuthology.orchestra.console.smithi096:Power on completed
2023-08-10T03:25:26.197 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2023-08-10T03:25:26.197 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:25:30.009 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:25:30.119 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is on
2023-08-10T03:25:30.220 INFO:teuthology.orchestra.console.smithi120:Power on completed
2023-08-10T03:25:30.321 INFO:teuthology.provision.fog.smithi120:Waiting for deploy to finish
2023-08-10T03:25:30.322 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:25:41.269 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:25:45.396 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:25:56.356 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:26:00.462 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:26:11.436 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:26:15.532 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:26:26.524 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:26:30.595 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:26:41.600 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:26:45.656 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:26:56.664 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:27:00.718 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:27:11.728 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:27:15.776 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:27:26.792 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:27:30.832 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:27:41.856 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:27:45.888 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:27:56.920 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:28:00.944 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:28:11.992 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-08-10T03:28:12.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:15.120 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:28:16.007 DEBUG:teuthology.provision.fog.smithi120:FOG request: GET /task/active None
2023-08-10T03:28:16.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:19.152 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:28:21.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:24.176 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:28:25.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:28.208 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:28:30.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:33.232 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:28:34.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:37.264 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:28:39.235 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:42.288 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:28:43.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:46.320 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:28:48.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:51.344 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:28:52.322 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:28:55.376 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:28:57.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:29:00.400 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-08-10T03:29:01.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:29:04.432 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:29:06.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:29:10.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:29:13.488 WARNING:teuthology.provision.fog.smithi120:[Errno None] Unable to connect to port 22 on 172.21.15.120
2023-08-10T03:29:19.493 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:29:38.170 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-10T03:29:38.171 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-10T03:29:51.179 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-08-10T03:29:51.180 DEBUG:teuthology.orchestra.run.smithi120:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-08-10T03:30:03.259 INFO:teuthology.provision.fog.smithi096:Node is ready
2023-08-10T03:30:03.259 DEBUG:teuthology.orchestra.run.smithi096:> hostname
2023-08-10T03:30:03.284 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2023-08-10T03:30:03.285 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts
2023-08-10T03:30:03.345 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2023-08-10T03:30:03.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-08-10T03:30:03.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts
2023-08-10T03:30:03.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts
2023-08-10T03:30:03.569 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname
2023-08-10T03:30:03.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-08-10T03:30:03.706 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-08-10T03:30:03.763 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2023-08-10T03:30:03.764 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T03:30:03.765 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T03:30:03.766 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2023-08-10T03:30:03.767 DEBUG:teuthology.parallel:result is None
2023-08-10T03:30:16.686 INFO:teuthology.provision.fog.smithi120:Node is ready
2023-08-10T03:30:16.686 DEBUG:teuthology.orchestra.run.smithi120:> hostname
2023-08-10T03:30:16.710 INFO:teuthology.orchestra.run.smithi120.stdout:smithi120.front.sepia.ceph.com
2023-08-10T03:30:16.710 DEBUG:teuthology.orchestra.run.smithi120:> grep smithi120.front.sepia.ceph.com /etc/hosts
2023-08-10T03:30:16.770 INFO:teuthology.orchestra.run.smithi120.stdout:172.21.15.120 smithi120.front.sepia.ceph.com smithi120
2023-08-10T03:30:16.771 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-08-10T03:30:16.914 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hosts
2023-08-10T03:30:16.946 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/172.21.15.120/172.21.15.120/g' /etc/hosts
2023-08-10T03:30:17.015 DEBUG:teuthology.orchestra.run.smithi120:> sudo sed -i -e 's/smithi120.front.sepia.ceph.com/smithi120/g' /etc/hostname
2023-08-10T03:30:17.085 DEBUG:teuthology.orchestra.run.smithi120:> sudo hostname smithi120
2023-08-10T03:30:17.152 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-08-10T03:30:17.210 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-08-10T03:30:17.210 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2023-08-10T03:30:17.210 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-08-10T03:30:17.210 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-08-10T03:30:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2023-08-10T03:30:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-08-10T03:30:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T03:30:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-08-10T03:30:17.211 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T03:30:17.212 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-08-10T03:30:17.212 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T03:30:17.212 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T03:30:17.212 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T03:30:17.213 INFO:teuthology.provision.fog.smithi120:Deploy complete!
2023-08-10T03:30:17.213 DEBUG:teuthology.parallel:result is None
2023-08-10T03:30:17.350 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2023-08-10T03:30:17.351 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-10T03:30:17.374 INFO:teuthology.lock.ops:Checking smithi120.front.sepia.ceph.com
2023-08-10T03:30:17.374 INFO:teuthology.lock.ops:New key found. Updating...
2023-08-10T03:30:17.392 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2023-08-10T03:30:17.392 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-08-10T03:30:17.393 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:30:17.462 DEBUG:teuthology.orchestra.run.smithi096:> true
2023-08-10T03:30:17.599 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-08-10T03:30:17.599 DEBUG:teuthology.orchestra.run.smithi096:> uname -m
2023-08-10T03:30:17.659 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2023-08-10T03:30:17.659 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-08-10T03:30:17.717 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2023-08-10T03:30:17.717 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2023-08-10T03:30:17.717 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2023-08-10T03:30:17.718 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T03:30:17.719 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2023-08-10T03:30:17.719 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T03:30:17.720 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T03:30:17.720 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T03:30:17.721 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-08-10T03:30:17.741 INFO:teuthology.lock.ops:Updating [smithi120.front.sepia.ceph.com]: set os type and version on server
2023-08-10T03:30:17.741 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-08-10T03:30:17.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi120.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-08-10T03:30:17.807 DEBUG:teuthology.orchestra.run.smithi120:> true
2023-08-10T03:30:17.874 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi120.front.sepia.ceph.com'
2023-08-10T03:30:17.874 DEBUG:teuthology.orchestra.run.smithi120:> uname -m
2023-08-10T03:30:17.932 INFO:teuthology.orchestra.run.smithi120.stdout:x86_64
2023-08-10T03:30:17.932 DEBUG:teuthology.orchestra.run.smithi120:> cat /etc/os-release
2023-08-10T03:30:17.993 INFO:teuthology.orchestra.run.smithi120.stdout:NAME="CentOS Stream"
2023-08-10T03:30:17.993 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION="8"
2023-08-10T03:30:17.993 INFO:teuthology.orchestra.run.smithi120.stdout:ID="centos"
2023-08-10T03:30:17.993 INFO:teuthology.orchestra.run.smithi120.stdout:ID_LIKE="rhel fedora"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:VERSION_ID="8"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:PLATFORM_ID="platform:el8"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:PRETTY_NAME="CentOS Stream 8"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:ANSI_COLOR="0;31"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:HOME_URL="https://centos.org/"
2023-08-10T03:30:17.994 INFO:teuthology.orchestra.run.smithi120.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-08-10T03:30:17.995 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-08-10T03:30:17.995 INFO:teuthology.orchestra.run.smithi120.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-08-10T03:30:17.995 INFO:teuthology.lock.ops:Updating smithi120.front.sepia.ceph.com on lock server
2023-08-10T03:30:18.016 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:30:18.106 INFO:teuthology.dispatcher.supervisor:Running job 7362310
2023-08-10T03:30:18.107 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362310 --name amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi --description rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} -- /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362310/orig.config.yaml
2023-08-10T03:30:18.111 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362310
2023-08-10T03:30:18.111 INFO:teuthology.dispatcher.supervisor:Job PID: 7904
2023-08-10T03:30:18.112 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-08-10T03:32:18.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:34:18.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:36:18.478 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:38:18.653 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:40:18.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:42:18.993 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-08-10T03:42:19.057 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-08-10T03:42:19.183 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-08-10T03:42:19.184 INFO:teuthology.nuke:Checking targets against current locks
2023-08-10T03:42:19.230 DEBUG:teuthology.nuke:shortname: smithi096
2023-08-10T03:42:19.230 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-10T03:42:19.250 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:25:20.180094', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDB3LzehqY7fP3Jjv8UbsG+fUziwmTdAHj55sim9c5pkkNFkH9wMm9aGT59f7qlZwjHSLJp4ZGOfndXocyT4o3fQ66wK/biW1DCofXxfcLuwiRBEhi7xm8Y4hhUSrD3LabPj658rpnx526X3+9hRizh92FelBgqPbIY/LSdNww8kFgO0yGNNhsIBiVpZFKpCktEmW3oRo0ZBQvYLFkO7hbZjE8edqROuZ16pwrIAZV9SYEGgFxxWmB0AlWrn1tyHxzd/Zlof3UUYxSm18UrWaiBtwGK+xQp33o8Dqv6GOgmp1No0AhN0mt8vg5nCGeW6UR5E72zU7xyT/2xM+Kdv179b3dMGBmXNTT+Lfl5BO8B51Bi8N1ntV4PX0i6jvbgqQon05j0ymDsCkmDG9qWFF2F67Oj66IriewftdSgsPbs/Xy1DqngFOcI1W3eM6o1eTSF6pqpM6JXq1fcOWep4iF4cEpkoVItrHOm1G+cuoTSoTUMAt+09o1lOuoUvYfzems='}
2023-08-10T03:42:19.253 DEBUG:teuthology.nuke:shortname: smithi120
2023-08-10T03:42:19.253 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-08-10T03:42:19.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi120.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amathuri-2023-08-07_14:27:31-rados:thrash-main-distro-default-smithi/7362310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 03:25:20.182122', 'locked_by': 'scheduled_amathuri@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmX7VV9Wt0y1c/4DM8zyCUiYE+dhg4eYhsp6dN4jiu8Fz3G0Vf4R/tGWjkZZB0sxwZZihOvBYVqGUK7HeCXW37d/yPovPyMKiTSj0gxqFKs6ku/uC2Jx/GwA1SyJT+aJ6+BUqh4IWHmiB86suxSRX6B797n9YpLwpGwJmA2f2t9u11BoBHAfn2nX8ImmpJPm2BcTQrcMkFh01Ha3bQadnNoXPmee5jY9ok9L8NWNSZTQH2t0Zw8TWdFkWqyK/bIflii7CrwlGzZCscSNzuKGhg9eYmDo4m0RtMOhnbl2UKskhl/Z6UUE4bseibE5d4Jg31o9tEWSjQ4rLKUTFPgtcIn94/mAaPq6o0XtfsaB+B/C9RLuHVHIbCtz5Wv+O+EkeU8Dz5Em0X4ZIWaUoRt57l/km7XxkUyOBspDosSocr5JMitHGDkn1yqyK+a7Hw0EvRMxA8ZStkimD1LOyXZWFA2QkFUGT6yPxrhJWChwF0rCGJo+FFVr45g9gDsuQaaGc='}
2023-08-10T03:42:19.297 INFO:teuthology.orchestra.console.smithi096:Power off
2023-08-10T03:42:19.298 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T03:42:19.319 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off
2023-08-10T03:42:19.319 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:42:19.343 INFO:teuthology.orchestra.console.smithi120:Power off
2023-08-10T03:42:19.344 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-08-10T03:42:19.353 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2023-08-10T03:42:19.363 DEBUG:teuthology.orchestra.console.smithi120:power off output: Chassis Power Control: Down/Off
2023-08-10T03:42:19.364 DEBUG:teuthology.orchestra.console.smithi120:pexpect command: ipmitool -H smithi120.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-08-10T03:42:19.386 DEBUG:teuthology.orchestra.console.smithi120:check power output: Chassis Power is off
2023-08-10T03:42:19.455 INFO:teuthology.orchestra.console.smithi096:Power off completed
2023-08-10T03:42:19.487 INFO:teuthology.orchestra.console.smithi120:Power off completed
2023-08-10T03:42:19.597 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com
2023-08-10T03:42:19.631 INFO:teuthology.lock.ops:unlocked: smithi120.front.sepia.ceph.com