2023-09-29T16:04:41.167 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-29T16:04:41.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:04:41.314 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f78d1be9be0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f78d26db670>, signals=[15])
2023-09-29T16:04:41.315 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging
2023-09-29T16:04:41.315 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T16:04:41.315 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-09-29T16:04:41.338 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging
2023-09-29T16:04:41.338 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server
2023-09-29T16:04:41.338 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2023-09-29T16:04:41.340 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"}
2023-09-29T16:04:41.363 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /host {"name": "smithi143"}
2023-09-29T16:04:41.413 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-29T16:04:41.438 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-29T16:04:41.454 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_8.stream (ID 3)
2023-09-29T16:04:41.454 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 3}
2023-09-29T16:04:41.478 DEBUG:teuthology.provision.fog.smithi143:Requesting image smithi_centos_8.stream (ID 3)
2023-09-29T16:04:41.478 DEBUG:teuthology.provision.fog.smithi143:FOG request: PUT /host/248 {"imageID": 3}
2023-09-29T16:04:41.499 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 8.stream
2023-09-29T16:04:41.499 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:04:41.515 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of centos 8.stream
2023-09-29T16:04:41.515 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:04:41.572 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T16:04:41.576 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"}
2023-09-29T16:04:41.612 DEBUG:teuthology.provision.fog.smithi143:FOG request: POST /host/248/task {"taskTypeID": 1}
2023-09-29T16:04:41.616 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1}
2023-09-29T16:04:41.670 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:04:41.674 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:04:41.781 INFO:teuthology.orchestra.console.smithi143:Power off
2023-09-29T16:04:41.782 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:04:41.795 INFO:teuthology.orchestra.console.smithi027:Power off
2023-09-29T16:04:41.795 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:04:41.806 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2023-09-29T16:04:41.806 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:41.819 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-09-29T16:04:41.820 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:41.832 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2023-09-29T16:04:41.842 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2023-09-29T16:04:45.834 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:45.842 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:45.943 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2023-09-29T16:04:45.952 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2023-09-29T16:04:49.946 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:49.954 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:50.057 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2023-09-29T16:04:50.063 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-09-29T16:04:50.163 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-09-29T16:04:50.264 INFO:teuthology.orchestra.console.smithi027:Power on
2023-09-29T16:04:50.264 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T16:04:50.288 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On
2023-09-29T16:04:50.289 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:50.312 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-09-29T16:04:54.059 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:54.387 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:54.490 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2023-09-29T16:04:54.497 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-09-29T16:04:54.596 INFO:teuthology.orchestra.console.smithi143:Power off completed
2023-09-29T16:04:54.697 INFO:teuthology.orchestra.console.smithi143:Power on
2023-09-29T16:04:54.697 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-29T16:04:54.721 DEBUG:teuthology.orchestra.console.smithi143:power on output: Chassis Power Control: Up/On
2023-09-29T16:04:54.721 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:54.745 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2023-09-29T16:04:58.502 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:58.611 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on
2023-09-29T16:04:58.711 INFO:teuthology.orchestra.console.smithi027:Power on completed
2023-09-29T16:04:58.775 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:04:58.813 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish
2023-09-29T16:04:58.813 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:04:58.883 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2023-09-29T16:05:02.887 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:05:02.999 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is on
2023-09-29T16:05:03.100 INFO:teuthology.orchestra.console.smithi143:Power on completed
2023-09-29T16:05:03.201 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish
2023-09-29T16:05:03.202 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:05:13.898 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:05:18.306 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:05:28.990 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:05:33.417 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:05:44.190 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:05:48.534 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:05:59.306 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:06:03.626 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:06:14.414 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:06:18.922 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:06:29.510 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:06:34.031 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:06:44.626 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:06:49.258 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:06:59.726 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:07:04.347 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:07:14.828 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:07:19.512 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:07:30.342 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:07:34.610 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:07:45.446 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:07:49.706 DEBUG:teuthology.provision.fog.smithi143:FOG request: GET /task/active None
2023-09-29T16:07:49.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:07:52.858 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:07:58.863 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:00.530 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:08:01.914 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:08:07.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:11.002 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:08:15.626 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None
2023-09-29T16:08:15.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:17.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:18.778 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:08:20.062 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:08:24.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:26.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:27.834 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:08:29.114 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:08:33.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:35.117 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:36.894 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:08:38.174 WARNING:teuthology.provision.fog.smithi143:[Errno None] Unable to connect to port 22 on 172.21.15.143
2023-09-29T16:08:42.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:44.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:45.978 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:08:51.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:08:56.670 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:02.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:05.758 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:12.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:15.582 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:21.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:24.670 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:30.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:33.754 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:39.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:42.814 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:09:44.179 WARNING:teuthology.provision.fog.smithi143:timed out
2023-09-29T16:09:48.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:50.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:09:50.448 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T16:09:50.448 DEBUG:teuthology.orchestra.run.smithi143:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T16:09:50.688 INFO:teuthology.provision.fog.smithi143:Node is ready
2023-09-29T16:09:50.688 DEBUG:teuthology.orchestra.run.smithi143:> hostname
2023-09-29T16:09:50.707 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143.front.sepia.ceph.com
2023-09-29T16:09:50.708 DEBUG:teuthology.orchestra.run.smithi143:> grep smithi143.front.sepia.ceph.com /etc/hosts
2023-09-29T16:09:50.767 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143
2023-09-29T16:09:50.767 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2023-09-29T16:09:50.887 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hosts
2023-09-29T16:09:50.916 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/172.21.15.143/172.21.15.143/g' /etc/hosts
2023-09-29T16:09:50.985 DEBUG:teuthology.orchestra.run.smithi143:> sudo sed -i -e 's/smithi143.front.sepia.ceph.com/smithi143/g' /etc/hostname
2023-09-29T16:09:51.053 DEBUG:teuthology.orchestra.run.smithi143:> sudo hostname smithi143
2023-09-29T16:09:51.120 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2023-09-29T16:09:51.179 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream"
2023-09-29T16:09:51.179 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8"
2023-09-29T16:09:51.179 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos"
2023-09-29T16:09:51.179 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:09:51.180 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T16:09:51.181 INFO:teuthology.provision.fog.smithi143:Deploy complete!
2023-09-29T16:09:51.182 DEBUG:teuthology.parallel:result is None
2023-09-29T16:10:07.354 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:10:13.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:10:16.414 WARNING:teuthology.provision.fog.smithi027:[Errno None] Unable to connect to port 22 on 172.21.15.27
2023-09-29T16:10:22.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:10:23.650 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-29T16:10:23.650 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-29T16:10:43.617 INFO:teuthology.provision.fog.smithi027:Node is ready
2023-09-29T16:10:43.617 DEBUG:teuthology.orchestra.run.smithi027:> hostname
2023-09-29T16:10:43.642 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com
2023-09-29T16:10:43.643 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts
2023-09-29T16:10:43.704 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027
2023-09-29T16:10:43.704 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-09-29T16:10:43.830 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts
2023-09-29T16:10:43.863 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts
2023-09-29T16:10:43.935 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname
2023-09-29T16:10:44.005 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027
2023-09-29T16:10:44.074 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-09-29T16:10:44.133 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2023-09-29T16:10:44.133 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2023-09-29T16:10:44.133 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2023-09-29T16:10:44.133 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2023-09-29T16:10:44.133 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:10:44.134 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T16:10:44.135 INFO:teuthology.provision.fog.smithi027:Deploy complete!
2023-09-29T16:10:44.135 DEBUG:teuthology.parallel:result is None
2023-09-29T16:10:44.289 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com
2023-09-29T16:10:44.289 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T16:10:44.317 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com
2023-09-29T16:10:44.317 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-29T16:10:44.343 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server
2023-09-29T16:10:44.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-09-29T16:10:44.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:10:44.410 DEBUG:teuthology.orchestra.run.smithi027:> true
2023-09-29T16:10:44.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com'
2023-09-29T16:10:44.437 DEBUG:teuthology.orchestra.run.smithi027:> uname -m
2023-09-29T16:10:44.496 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64
2023-09-29T16:10:44.497 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release
2023-09-29T16:10:44.555 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream"
2023-09-29T16:10:44.555 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8"
2023-09-29T16:10:44.555 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos"
2023-09-29T16:10:44.555 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:10:44.556 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T16:10:44.557 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server
2023-09-29T16:10:44.575 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server
2023-09-29T16:10:44.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com'
2023-09-29T16:10:44.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi143.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-29T16:10:44.645 DEBUG:teuthology.orchestra.run.smithi143:> true
2023-09-29T16:10:44.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi143.front.sepia.ceph.com'
2023-09-29T16:10:44.782 DEBUG:teuthology.orchestra.run.smithi143:> uname -m
2023-09-29T16:10:44.841 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64
2023-09-29T16:10:44.841 DEBUG:teuthology.orchestra.run.smithi143:> cat /etc/os-release
2023-09-29T16:10:44.900 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="CentOS Stream"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:ID="centos"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="rhel fedora"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://centos.org/"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-29T16:10:44.901 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-29T16:10:44.902 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-29T16:10:44.902 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server
2023-09-29T16:10:44.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:10:45.020 INFO:teuthology.dispatcher.supervisor:Running job 7405444
2023-09-29T16:10:45.020 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405444 --name yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} -- /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405444/orig.config.yaml
2023-09-29T16:10:45.024 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405444
2023-09-29T16:10:45.024 INFO:teuthology.dispatcher.supervisor:Job PID: 1408677
2023-09-29T16:10:45.024 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-29T16:12:45.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:14:45.287 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:16:45.460 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:18:45.623 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:20:45.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:22:45.959 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:24:46.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:26:46.291 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:28:46.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:30:46.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:32:46.787 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-29T16:32:46.854 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-09-29T16:32:46.967 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-09-29T16:32:46.967 INFO:teuthology.nuke:Checking targets against current locks
2023-09-29T16:32:47.013 DEBUG:teuthology.nuke:shortname: smithi027
2023-09-29T16:32:47.014 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-29T16:32:47.038 DEBUG:teuthology.nuke:shortname: smithi143
2023-09-29T16:32:47.038 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-09-29T16:32:47.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 16:04:40.297097', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO/XA8+1t/TgROoTtN2S1aSvHdRhD96zUPr60ZcZBRxhTN6TnE/uOaQCt8PCpPi23lNWeb+j7TkMdHqBrKReFfE='}
2023-09-29T16:32:47.063 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi143.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-28_11:54:11-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7405444', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-29 16:04:40.295148', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHS+a6txM5sX6OcdZ02DAx2zFjLIYfXqj8v1AynsPmynYo5YaLR/ufyOdmm0PbW8Q+FiPLm5Fj+qbSNdXCz1ASs='}
2023-09-29T16:32:47.095 INFO:teuthology.orchestra.console.smithi027:Power off
2023-09-29T16:32:47.095 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:32:47.116 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off
2023-09-29T16:32:47.116 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:32:47.129 INFO:teuthology.orchestra.console.smithi143:Power off
2023-09-29T16:32:47.129 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-29T16:32:47.138 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off
2023-09-29T16:32:47.150 DEBUG:teuthology.orchestra.console.smithi143:power off output: Chassis Power Control: Down/Off
2023-09-29T16:32:47.150 DEBUG:teuthology.orchestra.console.smithi143:pexpect command: ipmitool -H smithi143.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-29T16:32:47.170 DEBUG:teuthology.orchestra.console.smithi143:check power output: Chassis Power is off
2023-09-29T16:32:47.239 INFO:teuthology.orchestra.console.smithi027:Power off completed
2023-09-29T16:32:47.272 INFO:teuthology.orchestra.console.smithi143:Power off completed
2023-09-29T16:32:47.386 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com
2023-09-29T16:32:47.420 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com