2023-09-16T17:34:29.180 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-16T17:34:29.181 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:34:29.334 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f9b7e6fdd30>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f9b7e4a3ee0>, signals=[15])
2023-09-16T17:34:29.335 INFO:teuthology.lock.ops:Start node 'smithi098.front.sepia.ceph.com' reimaging
2023-09-16T17:34:29.336 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: reset os type and version on server
2023-09-16T17:34:29.336 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-16T17:34:29.361 INFO:teuthology.lock.ops:Start node 'smithi172.front.sepia.ceph.com' reimaging
2023-09-16T17:34:29.362 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: reset os type and version on server
2023-09-16T17:34:29.362 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-09-16T17:34:29.364 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /host {"name": "smithi098"}
2023-09-16T17:34:29.386 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /host {"name": "smithi172"}
2023-09-16T17:34:29.454 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-16T17:34:29.458 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-16T17:34:29.496 DEBUG:teuthology.provision.fog.smithi172:Requesting image smithi_centos_8.stream (ID 3)
2023-09-16T17:34:29.496 DEBUG:teuthology.provision.fog.smithi172:FOG request: PUT /host/277 {"imageID": 3}
2023-09-16T17:34:29.500 DEBUG:teuthology.provision.fog.smithi098:Requesting image smithi_centos_8.stream (ID 3)
2023-09-16T17:34:29.500 DEBUG:teuthology.provision.fog.smithi098:FOG request: PUT /host/203 {"imageID": 3}
2023-09-16T17:34:29.542 INFO:teuthology.provision.fog.smithi172:Scheduling deploy of centos 8.stream
2023-09-16T17:34:29.542 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:34:29.547 INFO:teuthology.provision.fog.smithi098:Scheduling deploy of centos 8.stream
2023-09-16T17:34:29.547 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:34:29.587 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /tasktype {"name": "deploy"}
2023-09-16T17:34:29.592 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /tasktype {"name": "deploy"}
2023-09-16T17:34:29.628 DEBUG:teuthology.provision.fog.smithi098:FOG request: POST /host/203/task {"taskTypeID": 1}
2023-09-16T17:34:29.632 DEBUG:teuthology.provision.fog.smithi172:FOG request: POST /host/277/task {"taskTypeID": 1}
2023-09-16T17:34:29.679 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:34:29.682 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:34:29.766 INFO:teuthology.orchestra.console.smithi172:Power off
2023-09-16T17:34:29.767 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T17:34:29.779 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-16T17:34:29.780 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T17:34:29.790 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2023-09-16T17:34:29.791 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:29.803 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-16T17:34:29.803 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:29.813 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-09-16T17:34:29.824 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-16T17:34:29.914 INFO:teuthology.orchestra.console.smithi172:Power off completed
2023-09-16T17:34:29.925 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-16T17:34:30.015 INFO:teuthology.orchestra.console.smithi172:Power on
2023-09-16T17:34:30.016 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-16T17:34:30.027 INFO:teuthology.orchestra.console.smithi098:Power on
2023-09-16T17:34:30.028 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-16T17:34:30.038 DEBUG:teuthology.orchestra.console.smithi172:power on output: Chassis Power Control: Up/On
2023-09-16T17:34:30.038 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:30.049 DEBUG:teuthology.orchestra.console.smithi098:power on output: Chassis Power Control: Up/On
2023-09-16T17:34:30.050 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:30.060 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-09-16T17:34:30.070 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-16T17:34:34.062 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:34.072 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:34.172 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-09-16T17:34:34.180 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-16T17:34:38.174 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:38.183 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T17:34:38.285 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is on
2023-09-16T17:34:38.291 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is on
2023-09-16T17:34:38.386 INFO:teuthology.orchestra.console.smithi172:Power on completed
2023-09-16T17:34:38.392 INFO:teuthology.orchestra.console.smithi098:Power on completed
2023-09-16T17:34:38.488 INFO:teuthology.provision.fog.smithi172:Waiting for deploy to finish
2023-09-16T17:34:38.488 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:34:38.493 INFO:teuthology.provision.fog.smithi098:Waiting for deploy to finish
2023-09-16T17:34:38.494 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:34:53.558 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:34:53.559 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:35:08.642 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:35:08.643 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:35:23.722 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:35:23.724 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:35:38.806 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:35:38.809 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:35:53.886 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:35:53.887 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:36:08.986 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:36:09.557 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:36:24.654 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:36:24.655 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:36:39.746 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:36:39.747 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:36:54.838 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:36:54.839 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:37:09.935 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:37:09.936 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:37:25.032 DEBUG:teuthology.provision.fog.smithi098:FOG request: GET /task/active None
2023-09-16T17:37:25.034 DEBUG:teuthology.provision.fog.smithi172:FOG request: GET /task/active None
2023-09-16T17:37:25.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:37:25.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:37:43.578 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-16T17:37:43.579 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:37:49.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:37:49.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:37:52.666 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-16T17:37:52.667 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:37:58.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:37:58.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:01.754 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-16T17:38:01.754 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:38:07.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:07.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:10.842 WARNING:teuthology.provision.fog.smithi098:[Errno None] Unable to connect to port 22 on 172.21.15.98
2023-09-16T17:38:10.842 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:38:16.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:16.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:19.898 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:38:25.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:38:28.954 WARNING:teuthology.provision.fog.smithi172:[Errno None] Unable to connect to port 22 on 172.21.15.172
2023-09-16T17:38:34.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:39:16.890 WARNING:teuthology.provision.fog.smithi098:timed out
2023-09-16T17:39:22.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:39:23.163 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-16T17:39:23.164 DEBUG:teuthology.orchestra.run.smithi098:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-16T17:39:23.410 INFO:teuthology.provision.fog.smithi098:Node is ready
2023-09-16T17:39:23.411 DEBUG:teuthology.orchestra.run.smithi098:> hostname
2023-09-16T17:39:23.470 INFO:teuthology.orchestra.run.smithi098.stdout:smithi098.front.sepia.ceph.com
2023-09-16T17:39:23.471 DEBUG:teuthology.orchestra.run.smithi098:> grep smithi098.front.sepia.ceph.com /etc/hosts
2023-09-16T17:39:23.530 INFO:teuthology.orchestra.run.smithi098.stdout:172.21.15.98 smithi098.front.sepia.ceph.com smithi098
2023-09-16T17:39:23.531 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-16T17:39:23.631 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hosts
2023-09-16T17:39:23.660 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/172.21.15.98/172.21.15.98/g' /etc/hosts
2023-09-16T17:39:23.729 DEBUG:teuthology.orchestra.run.smithi098:> sudo sed -i -e 's/smithi098.front.sepia.ceph.com/smithi098/g' /etc/hostname
2023-09-16T17:39:23.797 DEBUG:teuthology.orchestra.run.smithi098:> sudo hostname smithi098
2023-09-16T17:39:23.865 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-16T17:39:23.923 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-09-16T17:39:23.923 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-09-16T17:39:23.923 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-09-16T17:39:23.924 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-09-16T17:39:23.924 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-09-16T17:39:23.924 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-09-16T17:39:23.924 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T17:39:23.924 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-09-16T17:39:23.925 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T17:39:23.925 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-09-16T17:39:23.925 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T17:39:23.925 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T17:39:23.925 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T17:39:23.926 INFO:teuthology.provision.fog.smithi098:Deploy complete!
2023-09-16T17:39:23.927 DEBUG:teuthology.parallel:result is None
2023-09-16T17:39:34.974 WARNING:teuthology.provision.fog.smithi172:timed out
2023-09-16T17:39:40.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:39:41.200 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-16T17:39:41.200 DEBUG:teuthology.orchestra.run.smithi172:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-16T17:39:41.501 INFO:teuthology.provision.fog.smithi172:Node is ready
2023-09-16T17:39:41.502 DEBUG:teuthology.orchestra.run.smithi172:> hostname
2023-09-16T17:39:41.521 INFO:teuthology.orchestra.run.smithi172.stdout:smithi172.front.sepia.ceph.com
2023-09-16T17:39:41.522 DEBUG:teuthology.orchestra.run.smithi172:> grep smithi172.front.sepia.ceph.com /etc/hosts
2023-09-16T17:39:41.580 INFO:teuthology.orchestra.run.smithi172.stdout:172.21.15.172 smithi172.front.sepia.ceph.com smithi172
2023-09-16T17:39:41.581 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2023-09-16T17:39:41.685 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hosts
2023-09-16T17:39:41.716 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/172.21.15.172/172.21.15.172/g' /etc/hosts
2023-09-16T17:39:41.785 DEBUG:teuthology.orchestra.run.smithi172:> sudo sed -i -e 's/smithi172.front.sepia.ceph.com/smithi172/g' /etc/hostname
2023-09-16T17:39:41.854 DEBUG:teuthology.orchestra.run.smithi172:> sudo hostname smithi172
2023-09-16T17:39:41.921 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2023-09-16T17:39:41.979 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2023-09-16T17:39:41.979 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8"
2023-09-16T17:39:41.979 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2023-09-16T17:39:41.980 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2023-09-16T17:39:41.980 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8"
2023-09-16T17:39:41.980 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2023-09-16T17:39:41.980 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T17:39:41.980 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2023-09-16T17:39:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T17:39:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2023-09-16T17:39:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T17:39:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T17:39:41.981 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T17:39:41.982 INFO:teuthology.provision.fog.smithi172:Deploy complete!
2023-09-16T17:39:41.986 DEBUG:teuthology.parallel:result is None
2023-09-16T17:39:42.133 INFO:teuthology.lock.ops:Checking smithi098.front.sepia.ceph.com
2023-09-16T17:39:42.133 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-16T17:39:42.155 INFO:teuthology.lock.ops:Checking smithi172.front.sepia.ceph.com
2023-09-16T17:39:42.155 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-16T17:39:42.172 INFO:teuthology.lock.ops:Updating [smithi098.front.sepia.ceph.com]: set os type and version on server
2023-09-16T17:39:42.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-16T17:39:42.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi098.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:39:42.246 DEBUG:teuthology.orchestra.run.smithi098:> true
2023-09-16T17:39:42.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi098.front.sepia.ceph.com'
2023-09-16T17:39:42.381 DEBUG:teuthology.orchestra.run.smithi098:> uname -m
2023-09-16T17:39:42.440 INFO:teuthology.orchestra.run.smithi098.stdout:x86_64
2023-09-16T17:39:42.440 DEBUG:teuthology.orchestra.run.smithi098:> cat /etc/os-release
2023-09-16T17:39:42.499 INFO:teuthology.orchestra.run.smithi098.stdout:NAME="CentOS Stream"
2023-09-16T17:39:42.499 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION="8"
2023-09-16T17:39:42.499 INFO:teuthology.orchestra.run.smithi098.stdout:ID="centos"
2023-09-16T17:39:42.500 INFO:teuthology.orchestra.run.smithi098.stdout:ID_LIKE="rhel fedora"
2023-09-16T17:39:42.500 INFO:teuthology.orchestra.run.smithi098.stdout:VERSION_ID="8"
2023-09-16T17:39:42.500 INFO:teuthology.orchestra.run.smithi098.stdout:PLATFORM_ID="platform:el8"
2023-09-16T17:39:42.500 INFO:teuthology.orchestra.run.smithi098.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T17:39:42.500 INFO:teuthology.orchestra.run.smithi098.stdout:ANSI_COLOR="0;31"
2023-09-16T17:39:42.501 INFO:teuthology.orchestra.run.smithi098.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T17:39:42.501 INFO:teuthology.orchestra.run.smithi098.stdout:HOME_URL="https://centos.org/"
2023-09-16T17:39:42.501 INFO:teuthology.orchestra.run.smithi098.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T17:39:42.501 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T17:39:42.502 INFO:teuthology.orchestra.run.smithi098.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T17:39:42.502 INFO:teuthology.lock.ops:Updating smithi098.front.sepia.ceph.com on lock server
2023-09-16T17:39:42.522 INFO:teuthology.lock.ops:Updating [smithi172.front.sepia.ceph.com]: set os type and version on server
2023-09-16T17:39:42.522 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-09-16T17:39:42.523 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi172.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-16T17:39:42.587 DEBUG:teuthology.orchestra.run.smithi172:> true
2023-09-16T17:39:42.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi172.front.sepia.ceph.com'
2023-09-16T17:39:42.656 DEBUG:teuthology.orchestra.run.smithi172:> uname -m
2023-09-16T17:39:42.714 INFO:teuthology.orchestra.run.smithi172.stdout:x86_64
2023-09-16T17:39:42.715 DEBUG:teuthology.orchestra.run.smithi172:> cat /etc/os-release
2023-09-16T17:39:42.772 INFO:teuthology.orchestra.run.smithi172.stdout:NAME="CentOS Stream"
2023-09-16T17:39:42.772 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION="8"
2023-09-16T17:39:42.772 INFO:teuthology.orchestra.run.smithi172.stdout:ID="centos"
2023-09-16T17:39:42.773 INFO:teuthology.orchestra.run.smithi172.stdout:ID_LIKE="rhel fedora"
2023-09-16T17:39:42.773 INFO:teuthology.orchestra.run.smithi172.stdout:VERSION_ID="8"
2023-09-16T17:39:42.773 INFO:teuthology.orchestra.run.smithi172.stdout:PLATFORM_ID="platform:el8"
2023-09-16T17:39:42.773 INFO:teuthology.orchestra.run.smithi172.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-16T17:39:42.773 INFO:teuthology.orchestra.run.smithi172.stdout:ANSI_COLOR="0;31"
2023-09-16T17:39:42.774 INFO:teuthology.orchestra.run.smithi172.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-16T17:39:42.774 INFO:teuthology.orchestra.run.smithi172.stdout:HOME_URL="https://centos.org/"
2023-09-16T17:39:42.774 INFO:teuthology.orchestra.run.smithi172.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-16T17:39:42.774 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-16T17:39:42.774 INFO:teuthology.orchestra.run.smithi172.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-16T17:39:42.775 INFO:teuthology.lock.ops:Updating smithi172.front.sepia.ceph.com on lock server
2023-09-16T17:39:42.797 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:39:42.895 INFO:teuthology.dispatcher.supervisor:Running job 7397339
2023-09-16T17:39:42.895 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397339 --name teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi --description upgrade:pacific-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} -- /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397339/orig.config.yaml
2023-09-16T17:39:42.898 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397339
2023-09-16T17:39:42.899 INFO:teuthology.dispatcher.supervisor:Job PID: 582691
2023-09-16T17:39:42.899 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-16T17:41:42.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:43:43.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:45:43.339 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:47:43.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:49:43.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:51:43.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:53:44.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:55:44.244 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:57:44.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T17:59:44.583 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:01:44.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:03:44.914 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:05:45.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:07:45.235 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:09:45.402 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:11:45.567 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:13:45.741 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:15:45.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:17:46.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:19:46.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:21:46.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:23:46.498 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:25:46.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:27:46.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:29:47.000 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:31:47.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:33:47.331 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:35:47.496 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:37:47.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:39:47.834 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:41:47.986 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:43:48.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:45:48.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:47:48.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:49:48.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:51:48.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:53:48.891 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:55:49.038 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:57:49.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T18:59:49.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:01:49.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:03:49.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:05:50.094 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:07:50.249 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:09:50.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:11:50.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:13:50.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:15:50.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:17:51.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:19:51.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:21:51.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:23:51.568 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:25:51.730 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:27:51.885 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:29:52.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-16T19:29:52.117 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-16T19:29:52.339 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-16T19:29:52.340 INFO:teuthology.nuke:Checking targets against current locks
2023-09-16T19:29:52.385 DEBUG:teuthology.nuke:shortname: smithi098
2023-09-16T19:29:52.386 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-16T19:29:52.403 DEBUG:teuthology.nuke:shortname: smithi172
2023-09-16T19:29:52.404 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-16T19:29:52.406 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi098.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 17:34:28.349325', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFxh/IIVSs2An1wXyoZLZi7VOeh6aNAdHzc9sALFznYPCnx1gS7QGstvkvh3wln2ZgwlS7Az9qyYRWcojZKUIY4='}
2023-09-16T19:29:52.423 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi172.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2023-09-16_14:23:09-upgrade:pacific-x-reef-distro-default-smithi/7397339', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-16 17:34:28.351333', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFKOh7bOuxosym1T00qwkmLwf6rTtD2Dqwgvdx7WGNNwbcoqzTiSLc3wvyK6XsFeZMH/t81ZKvKMjCRXpnLK77s='}
2023-09-16T19:29:52.451 INFO:teuthology.orchestra.console.smithi098:Power off
2023-09-16T19:29:52.452 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T19:29:52.465 INFO:teuthology.orchestra.console.smithi172:Power off
2023-09-16T19:29:52.466 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-16T19:29:52.474 DEBUG:teuthology.orchestra.console.smithi098:power off output: Chassis Power Control: Down/Off
2023-09-16T19:29:52.475 DEBUG:teuthology.orchestra.console.smithi098:pexpect command: ipmitool -H smithi098.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T19:29:52.485 DEBUG:teuthology.orchestra.console.smithi172:power off output: Chassis Power Control: Down/Off
2023-09-16T19:29:52.486 DEBUG:teuthology.orchestra.console.smithi172:pexpect command: ipmitool -H smithi172.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-16T19:29:52.496 DEBUG:teuthology.orchestra.console.smithi098:check power output: Chassis Power is off
2023-09-16T19:29:52.507 DEBUG:teuthology.orchestra.console.smithi172:check power output: Chassis Power is off
2023-09-16T19:29:52.598 INFO:teuthology.orchestra.console.smithi098:Power off completed
2023-09-16T19:29:52.609 INFO:teuthology.orchestra.console.smithi172:Power off completed
2023-09-16T19:29:52.749 INFO:teuthology.lock.ops:unlocked: smithi098.front.sepia.ceph.com
2023-09-16T19:29:52.758 INFO:teuthology.lock.ops:unlocked: smithi172.front.sepia.ceph.com