2023-11-08T17:40:02.432 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-08T17:40:02.434 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:40:02.617 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f727cbd6b50>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f727d6db670>, signals=[15])
2023-11-08T17:40:02.619 INFO:teuthology.lock.ops:Start node 'smithi136.front.sepia.ceph.com' reimaging
2023-11-08T17:40:02.620 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T17:40:02.620 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-11-08T17:40:02.648 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging
2023-11-08T17:40:02.649 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server
2023-11-08T17:40:02.649 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-11-08T17:40:02.650 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /host {"name": "smithi136"}
2023-11-08T17:40:02.673 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /host {"name": "smithi169"}
2023-11-08T17:40:02.723 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-08T17:40:02.739 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-11-08T17:40:02.765 DEBUG:teuthology.provision.fog.smithi136:Requesting image smithi_centos_8.stream (ID 3)
2023-11-08T17:40:02.766 DEBUG:teuthology.provision.fog.smithi136:FOG request: PUT /host/241 {"imageID": 3}
2023-11-08T17:40:02.785 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3)
2023-11-08T17:40:02.786 DEBUG:teuthology.provision.fog.smithi169:FOG request: PUT /host/274 {"imageID": 3}
2023-11-08T17:40:02.812 INFO:teuthology.provision.fog.smithi136:Scheduling deploy of centos 8.stream
2023-11-08T17:40:02.813 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:40:02.835 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream
2023-11-08T17:40:02.835 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:40:02.882 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T17:40:02.890 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /tasktype {"name": "deploy"}
2023-11-08T17:40:02.922 DEBUG:teuthology.provision.fog.smithi169:FOG request: POST /host/274/task {"taskTypeID": 1}
2023-11-08T17:40:02.925 DEBUG:teuthology.provision.fog.smithi136:FOG request: POST /host/241/task {"taskTypeID": 1}
2023-11-08T17:40:02.986 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:40:03.009 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:40:03.078 INFO:teuthology.orchestra.console.smithi169:Power off
2023-11-08T17:40:03.079 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T17:40:03.095 INFO:teuthology.orchestra.console.smithi136:Power off
2023-11-08T17:40:03.096 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T17:40:03.106 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-11-08T17:40:03.107 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:03.121 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-11-08T17:40:03.121 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:03.131 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-11-08T17:40:03.145 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-11-08T17:40:07.136 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:07.146 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:07.245 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-11-08T17:40:07.259 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-11-08T17:40:11.250 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:11.260 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:11.360 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-11-08T17:40:11.371 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-11-08T17:40:11.472 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-11-08T17:40:11.573 INFO:teuthology.orchestra.console.smithi136:Power on
2023-11-08T17:40:11.573 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T17:40:11.596 DEBUG:teuthology.orchestra.console.smithi136:power on output: Chassis Power Control: Up/On
2023-11-08T17:40:11.597 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:11.621 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-11-08T17:40:15.362 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:15.471 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-11-08T17:40:15.572 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-11-08T17:40:15.622 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:15.673 INFO:teuthology.orchestra.console.smithi169:Power on
2023-11-08T17:40:15.674 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-08T17:40:15.696 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On
2023-11-08T17:40:15.697 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:15.720 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-11-08T17:40:15.731 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-11-08T17:40:19.722 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:19.732 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T17:40:19.832 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on
2023-11-08T17:40:19.844 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on
2023-11-08T17:40:19.933 INFO:teuthology.orchestra.console.smithi169:Power on completed
2023-11-08T17:40:19.945 INFO:teuthology.orchestra.console.smithi136:Power on completed
2023-11-08T17:40:20.035 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish
2023-11-08T17:40:20.036 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:40:20.046 INFO:teuthology.provision.fog.smithi136:Waiting for deploy to finish
2023-11-08T17:40:20.047 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:40:35.114 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:40:35.161 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:40:50.258 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:40:50.260 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:41:05.354 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:41:05.356 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:41:20.438 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:41:20.440 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:41:35.530 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:41:35.532 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:41:50.615 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:41:50.616 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:42:05.698 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:42:05.700 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:42:20.778 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:42:20.780 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:42:35.858 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:42:35.860 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:42:50.938 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:42:50.940 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:43:06.012 DEBUG:teuthology.provision.fog.smithi136:FOG request: GET /task/active None
2023-11-08T17:43:06.020 DEBUG:teuthology.provision.fog.smithi169:FOG request: GET /task/active None
2023-11-08T17:43:06.074 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:06.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:06.204 ERROR:teuthology.orchestra.connection:Error authenticating with smithi169.front.sepia.ceph.com: AuthenticationException('Authentication failed.')
2023-11-08T17:43:09.150 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:43:15.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:18.202 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:43:24.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:27.258 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:43:33.260 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:36.318 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:43:42.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:45.370 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:43:51.372 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:43:54.430 WARNING:teuthology.provision.fog.smithi136:[Errno None] Unable to connect to port 22 on 172.21.15.136
2023-11-08T17:44:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:10.210 WARNING:teuthology.provision.fog.smithi169:timed out
2023-11-08T17:44:16.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:19.294 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:44:25.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:28.378 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:44:34.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:37.438 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:44:43.440 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:46.522 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:44:52.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:44:55.582 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:00.435 WARNING:teuthology.provision.fog.smithi136:timed out
2023-11-08T17:45:01.584 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:04.666 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:06.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:06.704 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T17:45:06.705 DEBUG:teuthology.orchestra.run.smithi136:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T17:45:06.998 INFO:teuthology.provision.fog.smithi136:Node is ready
2023-11-08T17:45:06.998 DEBUG:teuthology.orchestra.run.smithi136:> hostname
2023-11-08T17:45:07.018 INFO:teuthology.orchestra.run.smithi136.stdout:smithi136.front.sepia.ceph.com
2023-11-08T17:45:07.018 DEBUG:teuthology.orchestra.run.smithi136:> grep smithi136.front.sepia.ceph.com /etc/hosts
2023-11-08T17:45:07.077 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.15.136 smithi136.front.sepia.ceph.com smithi136
2023-11-08T17:45:07.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-11-08T17:45:07.182 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hosts
2023-11-08T17:45:07.211 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/172.21.15.136/172.21.15.136/g' /etc/hosts
2023-11-08T17:45:07.279 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i -e 's/smithi136.front.sepia.ceph.com/smithi136/g' /etc/hostname
2023-11-08T17:45:07.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname smithi136
2023-11-08T17:45:07.415 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-11-08T17:45:07.473 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2023-11-08T17:45:07.473 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2023-11-08T17:45:07.473 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2023-11-08T17:45:07.474 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2023-11-08T17:45:07.474 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2023-11-08T17:45:07.474 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-11-08T17:45:07.474 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-08T17:45:07.474 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-11-08T17:45:07.475 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-08T17:45:07.475 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2023-11-08T17:45:07.475 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T17:45:07.475 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T17:45:07.475 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-08T17:45:07.476 INFO:teuthology.provision.fog.smithi136:Deploy complete!
2023-11-08T17:45:07.477 DEBUG:teuthology.parallel:result is None
2023-11-08T17:45:10.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:13.722 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:19.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:22.778 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:28.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:31.838 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:37.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:45:40.926 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169
2023-11-08T17:45:46.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:46:46.931 WARNING:teuthology.provision.fog.smithi169:timed out
2023-11-08T17:46:52.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:46:53.141 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-08T17:46:53.142 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-08T17:46:53.409 INFO:teuthology.provision.fog.smithi169:Node is ready
2023-11-08T17:46:53.409 DEBUG:teuthology.orchestra.run.smithi169:> hostname
2023-11-08T17:46:53.429 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com
2023-11-08T17:46:53.430 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts
2023-11-08T17:46:53.491 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169
2023-11-08T17:46:53.491 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-11-08T17:46:53.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts
2023-11-08T17:46:53.626 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts
2023-11-08T17:46:53.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname
2023-11-08T17:46:53.768 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169
2023-11-08T17:46:53.835 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-11-08T17:46:53.894 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-11-08T17:46:53.895 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2023-11-08T17:46:53.895 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-11-08T17:46:53.895 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-11-08T17:46:53.895 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2023-11-08T17:46:53.895 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T17:46:53.896 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T17:46:53.897 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-08T17:46:53.897 INFO:teuthology.provision.fog.smithi169:Deploy complete!
2023-11-08T17:46:53.898 DEBUG:teuthology.parallel:result is None
2023-11-08T17:46:54.048 INFO:teuthology.lock.ops:Checking smithi136.front.sepia.ceph.com
2023-11-08T17:46:54.048 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T17:46:54.070 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com
2023-11-08T17:46:54.071 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-08T17:46:54.098 INFO:teuthology.lock.ops:Updating [smithi136.front.sepia.ceph.com]: set os type and version on server
2023-11-08T17:46:54.098 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-11-08T17:46:54.099 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:46:54.169 DEBUG:teuthology.orchestra.run.smithi136:> true
2023-11-08T17:46:54.302 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com'
2023-11-08T17:46:54.302 DEBUG:teuthology.orchestra.run.smithi136:> uname -m
2023-11-08T17:46:54.361 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64
2023-11-08T17:46:54.361 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release
2023-11-08T17:46:54.420 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream"
2023-11-08T17:46:54.420 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="8"
2023-11-08T17:46:54.421 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos"
2023-11-08T17:46:54.421 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora"
2023-11-08T17:46:54.421 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="8"
2023-11-08T17:46:54.421 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el8"
2023-11-08T17:46:54.421 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-08T17:46:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31"
2023-11-08T17:46:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-08T17:46:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/"
2023-11-08T17:46:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T17:46:54.422 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T17:46:54.423 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-08T17:46:54.423 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server
2023-11-08T17:46:54.446 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server
2023-11-08T17:46:54.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-11-08T17:46:54.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-08T17:46:54.513 DEBUG:teuthology.orchestra.run.smithi169:> true
2023-11-08T17:46:54.585 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com'
2023-11-08T17:46:54.586 DEBUG:teuthology.orchestra.run.smithi169:> uname -m
2023-11-08T17:46:54.644 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64
2023-11-08T17:46:54.644 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release
2023-11-08T17:46:54.702 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream"
2023-11-08T17:46:54.702 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8"
2023-11-08T17:46:54.703 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos"
2023-11-08T17:46:54.703 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora"
2023-11-08T17:46:54.703 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8"
2023-11-08T17:46:54.703 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8"
2023-11-08T17:46:54.703 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8"
2023-11-08T17:46:54.704 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31"
2023-11-08T17:46:54.704 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-11-08T17:46:54.704 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/"
2023-11-08T17:46:54.704 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-08T17:46:54.704 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-08T17:46:54.705 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-11-08T17:46:54.705 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server
2023-11-08T17:46:54.729 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:46:54.823 INFO:teuthology.dispatcher.supervisor:Running job 7452076
2023-11-08T17:46:54.824 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452076 --name yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi --description rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452076/orig.config.yaml
2023-11-08T17:46:54.827 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452076
2023-11-08T17:46:54.827 INFO:teuthology.dispatcher.supervisor:Job PID: 2736792
2023-11-08T17:46:54.828 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-08T17:48:54.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:50:54.903 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:52:54.967 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:54:55.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:56:55.109 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T17:58:55.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:00:55.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:02:55.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:04:55.403 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:06:55.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:08:55.537 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:10:55.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:12:55.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:14:55.728 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:16:55.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-08T18:16:55.877 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-08T18:16:55.993 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-08T18:16:55.994 INFO:teuthology.nuke:Checking targets against current locks
2023-11-08T18:16:56.044 DEBUG:teuthology.nuke:shortname: smithi136
2023-11-08T18:16:56.045 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T18:16:56.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 17:40:01.604058', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHslF1ohZKkBfyeCzuUQbn5yp3SsbIpc02DDheJeltkMNbfw7/lCq4G3XhpWOWsZsciwgxA+bp/4xSiE477vMV4='}
2023-11-08T18:16:56.071 DEBUG:teuthology.nuke:shortname: smithi169
2023-11-08T18:16:56.071 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-08T18:16:56.091 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-08_16:14:24-rados-wip-yuri3-testing-2023-11-07-0801-pacific-distro-default-smithi/7452076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-08 17:40:01.605460', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/5FuDLbM7pOnRrvJ41UNlvCv99RQNDtHmnX/2Gu7b0aNwLYcSUarqtKmCBtwLAboh05+XsHN33WhQoblo8tho='}
2023-11-08T18:16:56.123 INFO:teuthology.orchestra.console.smithi136:Power off
2023-11-08T18:16:56.124 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T18:16:56.147 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off
2023-11-08T18:16:56.148 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T18:16:56.162 INFO:teuthology.orchestra.console.smithi169:Power off
2023-11-08T18:16:56.162 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-08T18:16:56.172 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off
2023-11-08T18:16:56.186 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off
2023-11-08T18:16:56.187 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-08T18:16:56.211 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off
2023-11-08T18:16:56.273 INFO:teuthology.orchestra.console.smithi136:Power off completed
2023-11-08T18:16:56.312 INFO:teuthology.orchestra.console.smithi169:Power off completed
2023-11-08T18:16:56.426 INFO:teuthology.lock.ops:unlocked: smithi136.front.sepia.ceph.com
2023-11-08T18:16:56.459 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com