2023-09-11T13:09:18.345 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-11T13:09:18.347 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:09:18.493 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f8fcba59c70>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f8fcb708ee0>, signals=[15])
2023-09-11T13:09:18.494 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging
2023-09-11T13:09:18.495 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server
2023-09-11T13:09:18.495 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-09-11T13:09:18.515 INFO:teuthology.lock.ops:Start node 'smithi151.front.sepia.ceph.com' reimaging
2023-09-11T13:09:18.516 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: reset os type and version on server
2023-09-11T13:09:18.516 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-09-11T13:09:18.517 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /host {"name": "smithi050"}
2023-09-11T13:09:18.540 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /host {"name": "smithi151"}
2023-09-11T13:09:18.591 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-11T13:09:18.609 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-11T13:09:18.635 DEBUG:teuthology.provision.fog.smithi050:Requesting image smithi_centos_8.stream (ID 3)
2023-09-11T13:09:18.635 DEBUG:teuthology.provision.fog.smithi050:FOG request: PUT /host/155 {"imageID": 3}
2023-09-11T13:09:18.649 DEBUG:teuthology.provision.fog.smithi151:Requesting image smithi_centos_8.stream (ID 3)
2023-09-11T13:09:18.650 DEBUG:teuthology.provision.fog.smithi151:FOG request: PUT /host/256 {"imageID": 3}
2023-09-11T13:09:18.680 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream
2023-09-11T13:09:18.681 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:09:18.701 INFO:teuthology.provision.fog.smithi151:Scheduling deploy of centos 8.stream
2023-09-11T13:09:18.702 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:09:18.725 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /tasktype {"name": "deploy"}
2023-09-11T13:09:18.746 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /tasktype {"name": "deploy"}
2023-09-11T13:09:18.762 DEBUG:teuthology.provision.fog.smithi050:FOG request: POST /host/155/task {"taskTypeID": 1}
2023-09-11T13:09:18.783 DEBUG:teuthology.provision.fog.smithi151:FOG request: POST /host/256/task {"taskTypeID": 1}
2023-09-11T13:09:18.886 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:09:18.902 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:09:18.972 INFO:teuthology.orchestra.console.smithi050:Power off
2023-09-11T13:09:18.973 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-11T13:09:18.993 INFO:teuthology.orchestra.console.smithi151:Power off
2023-09-11T13:09:18.993 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-11T13:09:19.004 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-09-11T13:09:19.005 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:19.018 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-09-11T13:09:19.019 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:19.029 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-09-11T13:09:19.045 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-11T13:09:23.035 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:23.046 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:23.148 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-09-11T13:09:23.157 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-11T13:09:27.152 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:27.160 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:27.262 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-11T13:09:27.269 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-11T13:09:27.364 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-09-11T13:09:27.465 INFO:teuthology.orchestra.console.smithi050:Power on
2023-09-11T13:09:27.465 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-11T13:09:27.486 DEBUG:teuthology.orchestra.console.smithi050:power on output: Chassis Power Control: Up/On
2023-09-11T13:09:27.487 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:27.509 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-11T13:09:31.274 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:31.383 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-11T13:09:31.484 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-09-11T13:09:31.511 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:31.585 INFO:teuthology.orchestra.console.smithi151:Power on
2023-09-11T13:09:31.586 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-11T13:09:31.606 DEBUG:teuthology.orchestra.console.smithi151:power on output: Chassis Power Control: Up/On
2023-09-11T13:09:31.607 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:31.620 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-11T13:09:31.628 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-11T13:09:35.625 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:35.632 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:35.734 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is on
2023-09-11T13:09:35.741 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-11T13:09:35.836 INFO:teuthology.orchestra.console.smithi050:Power on completed
2023-09-11T13:09:35.937 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish
2023-09-11T13:09:35.937 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:09:39.746 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T13:09:39.976 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on
2023-09-11T13:09:40.077 INFO:teuthology.orchestra.console.smithi151:Power on completed
2023-09-11T13:09:40.178 INFO:teuthology.provision.fog.smithi151:Waiting for deploy to finish
2023-09-11T13:09:40.178 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:09:50.998 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:09:55.238 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:10:06.062 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:10:10.294 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:10:21.130 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:10:25.352 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:10:36.198 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:10:40.430 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:10:51.288 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:10:55.510 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:11:06.374 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:11:10.591 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:11:21.463 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:11:25.674 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:11:36.557 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:11:40.754 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:11:51.654 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:11:55.838 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:12:06.734 DEBUG:teuthology.provision.fog.smithi050:FOG request: GET /task/active None
2023-09-11T13:12:06.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:09.886 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:10.912 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:12:15.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:18.974 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:24.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:25.982 DEBUG:teuthology.provision.fog.smithi151:FOG request: GET /task/active None
2023-09-11T13:12:26.051 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:28.058 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:29.114 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:12:34.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:35.116 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:37.114 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:38.174 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:12:43.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:44.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:46.170 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:47.226 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:12:52.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:53.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:12:55.258 WARNING:teuthology.provision.fog.smithi050:[Errno None] Unable to connect to port 22 on 172.21.15.50
2023-09-11T13:12:56.286 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:13:01.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:13:02.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:13:05.370 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:13:11.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:13:14.433 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:13:20.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:13:23.514 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:13:29.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:13:32.570 WARNING:teuthology.provision.fog.smithi151:[Errno None] Unable to connect to port 22 on 172.21.15.151
2023-09-11T13:13:38.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:14:01.286 WARNING:teuthology.provision.fog.smithi050:timed out
2023-09-11T13:14:07.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:14:07.563 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-11T13:14:07.564 DEBUG:teuthology.orchestra.run.smithi050:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-11T13:14:07.807 INFO:teuthology.provision.fog.smithi050:Node is ready
2023-09-11T13:14:07.807 DEBUG:teuthology.orchestra.run.smithi050:> hostname
2023-09-11T13:14:07.827 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com
2023-09-11T13:14:07.827 DEBUG:teuthology.orchestra.run.smithi050:> grep smithi050.front.sepia.ceph.com /etc/hosts
2023-09-11T13:14:07.887 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050
2023-09-11T13:14:07.887 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-09-11T13:14:07.977 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hosts
2023-09-11T13:14:08.008 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/172.21.15.50/172.21.15.50/g' /etc/hosts
2023-09-11T13:14:08.078 DEBUG:teuthology.orchestra.run.smithi050:> sudo sed -i -e 's/smithi050.front.sepia.ceph.com/smithi050/g' /etc/hostname
2023-09-11T13:14:08.146 DEBUG:teuthology.orchestra.run.smithi050:> sudo hostname smithi050
2023-09-11T13:14:08.214 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-09-11T13:14:08.272 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-09-11T13:14:08.272 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2023-09-11T13:14:08.272 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-09-11T13:14:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-09-11T13:14:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2023-09-11T13:14:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2023-09-11T13:14:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-11T13:14:08.273 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-09-11T13:14:08.274 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-11T13:14:08.274 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-09-11T13:14:08.274 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-11T13:14:08.274 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-11T13:14:08.274 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-11T13:14:08.275 INFO:teuthology.provision.fog.smithi050:Deploy complete!
2023-09-11T13:14:08.276 DEBUG:teuthology.parallel:result is None
2023-09-11T13:14:38.606 WARNING:teuthology.provision.fog.smithi151:timed out
2023-09-11T13:14:44.611 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:14:44.806 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-11T13:14:44.806 DEBUG:teuthology.orchestra.run.smithi151:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-11T13:14:45.040 INFO:teuthology.provision.fog.smithi151:Node is ready
2023-09-11T13:14:45.040 DEBUG:teuthology.orchestra.run.smithi151:> hostname
2023-09-11T13:14:45.058 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151.front.sepia.ceph.com
2023-09-11T13:14:45.059 DEBUG:teuthology.orchestra.run.smithi151:> grep smithi151.front.sepia.ceph.com /etc/hosts
2023-09-11T13:14:45.117 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151 smithi151.front.sepia.ceph.com smithi151
2023-09-11T13:14:45.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-09-11T13:14:45.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hosts
2023-09-11T13:14:45.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/172.21.15.151/172.21.15.151/g' /etc/hosts
2023-09-11T13:14:45.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i -e 's/smithi151.front.sepia.ceph.com/smithi151/g' /etc/hostname
2023-09-11T13:14:45.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname smithi151
2023-09-11T13:14:45.454 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-09-11T13:14:45.512 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8"
2023-09-11T13:14:45.513 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-11T13:14:45.514 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-09-11T13:14:45.514 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-11T13:14:45.514 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2023-09-11T13:14:45.514 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-11T13:14:45.514 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-11T13:14:45.515 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-11T13:14:45.515 INFO:teuthology.provision.fog.smithi151:Deploy complete!
2023-09-11T13:14:45.516 DEBUG:teuthology.parallel:result is None
2023-09-11T13:14:45.672 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com
2023-09-11T13:14:45.673 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-11T13:14:45.727 INFO:teuthology.lock.ops:Checking smithi151.front.sepia.ceph.com
2023-09-11T13:14:45.728 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-11T13:14:45.801 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server
2023-09-11T13:14:45.802 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-09-11T13:14:45.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi050.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:14:45.871 DEBUG:teuthology.orchestra.run.smithi050:> true
2023-09-11T13:14:46.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi050.front.sepia.ceph.com'
2023-09-11T13:14:46.010 DEBUG:teuthology.orchestra.run.smithi050:> uname -m
2023-09-11T13:14:46.069 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64
2023-09-11T13:14:46.070 DEBUG:teuthology.orchestra.run.smithi050:> cat /etc/os-release
2023-09-11T13:14:46.129 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream"
2023-09-11T13:14:46.130 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8"
2023-09-11T13:14:46.130 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos"
2023-09-11T13:14:46.130 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora"
2023-09-11T13:14:46.130 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8"
2023-09-11T13:14:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8"
2023-09-11T13:14:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-11T13:14:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31"
2023-09-11T13:14:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-11T13:14:46.131 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/"
2023-09-11T13:14:46.132 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-11T13:14:46.132 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-11T13:14:46.132 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-11T13:14:46.132 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server
2023-09-11T13:14:46.169 INFO:teuthology.lock.ops:Updating [smithi151.front.sepia.ceph.com]: set os type and version on server
2023-09-11T13:14:46.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-09-11T13:14:46.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-11T13:14:46.235 DEBUG:teuthology.orchestra.run.smithi151:> true
2023-09-11T13:14:46.306 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com'
2023-09-11T13:14:46.306 DEBUG:teuthology.orchestra.run.smithi151:> uname -m
2023-09-11T13:14:46.366 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64
2023-09-11T13:14:46.366 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release
2023-09-11T13:14:46.424 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream"
2023-09-11T13:14:46.425 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8"
2023-09-11T13:14:46.425 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos"
2023-09-11T13:14:46.425 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora"
2023-09-11T13:14:46.425 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8"
2023-09-11T13:14:46.426 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8"
2023-09-11T13:14:46.426 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-11T13:14:46.426 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31"
2023-09-11T13:14:46.426 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-11T13:14:46.427 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/"
2023-09-11T13:14:46.427 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-11T13:14:46.427 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-11T13:14:46.427 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-11T13:14:46.428 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server
2023-09-11T13:14:46.452 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:14:46.549 INFO:teuthology.dispatcher.supervisor:Running job 7393527
2023-09-11T13:14:46.549 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393527 --name vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} -- /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393527/orig.config.yaml
2023-09-11T13:14:46.552 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393527
2023-09-11T13:14:46.553 INFO:teuthology.dispatcher.supervisor:Job PID: 3295823
2023-09-11T13:14:46.553 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-11T13:16:46.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:18:46.822 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:20:46.995 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:22:47.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:24:47.352 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:26:47.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:28:47.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:30:47.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:32:48.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:34:48.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:36:48.411 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:38:48.485 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:40:48.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:42:48.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:44:49.004 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:46:49.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:48:49.351 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:50:49.527 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:52:49.703 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:54:49.828 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:56:50.007 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T13:58:50.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:00:50.355 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:02:50.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:04:50.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:06:50.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:08:51.043 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:10:51.211 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:12:51.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:14:51.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:16:51.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:18:51.883 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:20:52.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:22:52.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:24:52.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:26:52.551 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:28:52.719 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-11T14:28:52.783 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-09-11T14:28:52.968 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-11T14:28:52.968 INFO:teuthology.nuke:Checking targets against current locks
2023-09-11T14:28:53.016 DEBUG:teuthology.nuke:shortname: smithi050
2023-09-11T14:28:53.017 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-11T14:28:53.034 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi050.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 13:09:17.515385', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKbnXQjvgnFGhF0q+YqO7LB8vwkJhKs/qVLGMHccH/7nN+u+wdgjQm3rK+Egq0dpBcYuUDu0R2MKmVOfRo4+B+I='}
2023-09-11T14:28:53.037 DEBUG:teuthology.nuke:shortname: smithi151
2023-09-11T14:28:53.038 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-11T14:28:53.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-09-11_09:35:04-fs-wip-vshankar-testing-20230911.055957-testing-default-smithi/7393527', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-11 13:09:17.513956', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFCsei7LVPPR+GxSIk6UZQ3kdeOhavUDGJn96sdhknLs7Mu8KO7GxKN6xABQLaDKB5lFbCSsOxa/ysAgJNQGE7M='}
2023-09-11T14:28:53.074 INFO:teuthology.orchestra.console.smithi050:Power off
2023-09-11T14:28:53.075 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-11T14:28:53.097 DEBUG:teuthology.orchestra.console.smithi050:power off output: Chassis Power Control: Down/Off
2023-09-11T14:28:53.098 DEBUG:teuthology.orchestra.console.smithi050:pexpect command: ipmitool -H smithi050.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T14:28:53.110 INFO:teuthology.orchestra.console.smithi151:Power off
2023-09-11T14:28:53.110 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-11T14:28:53.119 DEBUG:teuthology.orchestra.console.smithi050:check power output: Chassis Power is off
2023-09-11T14:28:53.130 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off
2023-09-11T14:28:53.131 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-11T14:28:53.154 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off
2023-09-11T14:28:53.220 INFO:teuthology.orchestra.console.smithi050:Power off completed
2023-09-11T14:28:53.256 INFO:teuthology.orchestra.console.smithi151:Power off completed
2023-09-11T14:28:53.376 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com
2023-09-11T14:28:53.399 INFO:teuthology.lock.ops:unlocked: smithi151.front.sepia.ceph.com