2023-10-01T15:21:29.130 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-10-01T15:21:29.130 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:21:29.286 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f0946243b80>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f0946d35670>, signals=[15])
2023-10-01T15:21:29.286 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging
2023-10-01T15:21:29.287 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T15:21:29.287 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2023-10-01T15:21:29.307 INFO:teuthology.lock.ops:Start node 'smithi099.front.sepia.ceph.com' reimaging
2023-10-01T15:21:29.307 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: reset os type and version on server
2023-10-01T15:21:29.307 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-01T15:21:29.309 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /host {"name": "smithi084"}
2023-10-01T15:21:29.332 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /host {"name": "smithi099"}
2023-10-01T15:21:29.392 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-01T15:21:29.400 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-10-01T15:21:29.434 DEBUG:teuthology.provision.fog.smithi084:Requesting image smithi_centos_8.stream (ID 3)
2023-10-01T15:21:29.434 DEBUG:teuthology.provision.fog.smithi084:FOG request: PUT /host/189 {"imageID": 3}
2023-10-01T15:21:29.444 DEBUG:teuthology.provision.fog.smithi099:Requesting image smithi_centos_8.stream (ID 3)
2023-10-01T15:21:29.444 DEBUG:teuthology.provision.fog.smithi099:FOG request: PUT /host/204 {"imageID": 3}
2023-10-01T15:21:29.480 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of centos 8.stream
2023-10-01T15:21:29.480 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:21:29.486 INFO:teuthology.provision.fog.smithi099:Scheduling deploy of centos 8.stream
2023-10-01T15:21:29.486 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:21:29.664 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T15:21:29.673 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /tasktype {"name": "deploy"}
2023-10-01T15:21:29.700 DEBUG:teuthology.provision.fog.smithi084:FOG request: POST /host/189/task {"taskTypeID": 1}
2023-10-01T15:21:29.714 DEBUG:teuthology.provision.fog.smithi099:FOG request: POST /host/204/task {"taskTypeID": 1}
2023-10-01T15:21:29.820 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:21:29.832 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:21:30.053 INFO:teuthology.orchestra.console.smithi084:Power off
2023-10-01T15:21:30.053 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T15:21:30.077 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off
2023-10-01T15:21:30.077 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:30.097 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-01T15:21:30.097 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T15:21:30.104 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2023-10-01T15:21:30.115 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-01T15:21:30.116 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:30.136 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-01T15:21:30.236 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-01T15:21:30.337 INFO:teuthology.orchestra.console.smithi099:Power on
2023-10-01T15:21:30.337 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T15:21:30.358 DEBUG:teuthology.orchestra.console.smithi099:power on output: Chassis Power Control: Up/On
2023-10-01T15:21:30.359 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:30.378 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-01T15:21:34.106 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:34.215 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2023-10-01T15:21:34.379 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:34.487 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-01T15:21:38.220 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:38.327 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2023-10-01T15:21:38.488 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:38.596 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on
2023-10-01T15:21:38.697 INFO:teuthology.orchestra.console.smithi099:Power on completed
2023-10-01T15:21:38.798 INFO:teuthology.provision.fog.smithi099:Waiting for deploy to finish
2023-10-01T15:21:38.798 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:21:42.331 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:42.439 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2023-10-01T15:21:42.539 INFO:teuthology.orchestra.console.smithi084:Power off completed
2023-10-01T15:21:42.640 INFO:teuthology.orchestra.console.smithi084:Power on
2023-10-01T15:21:42.640 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-10-01T15:21:42.660 DEBUG:teuthology.orchestra.console.smithi084:power on output: Chassis Power Control: Up/On
2023-10-01T15:21:42.661 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:42.681 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2023-10-01T15:21:46.686 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T15:21:46.793 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is on
2023-10-01T15:21:46.894 INFO:teuthology.orchestra.console.smithi084:Power on completed
2023-10-01T15:21:46.995 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish
2023-10-01T15:21:46.995 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:21:53.992 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:22:02.205 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:22:09.171 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:22:17.381 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:22:24.349 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:22:32.566 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:22:39.541 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:22:47.761 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:22:54.753 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:23:02.966 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:23:10.003 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:23:18.218 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:23:25.266 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:23:33.872 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:24:12.410 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:24:12.604 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:24:31.675 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:24:31.902 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:24:50.914 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:24:50.993 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:25:08.906 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:25:09.211 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:25:25.598 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:25:26.228 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:25:40.909 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:25:42.884 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:25:56.253 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:25:59.581 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:26:11.508 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:26:15.058 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:26:26.732 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:26:30.406 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:26:42.114 DEBUG:teuthology.provision.fog.smithi099:FOG request: GET /task/active None
2023-10-01T15:26:42.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:26:45.338 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:26:45.791 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:26:51.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:26:54.426 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:27:00.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:00.957 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:27:03.514 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:27:09.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:12.602 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:27:16.129 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:27:18.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:21.659 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:27:27.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:30.746 WARNING:teuthology.provision.fog.smithi099:[Errno None] Unable to connect to port 22 on 172.21.15.99
2023-10-01T15:27:31.264 DEBUG:teuthology.provision.fog.smithi084:FOG request: GET /task/active None
2023-10-01T15:27:31.446 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:34.522 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:27:36.749 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:40.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:43.578 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:27:49.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:27:52.666 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:27:58.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:01.723 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:28:07.731 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:10.810 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:28:16.817 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:19.899 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:28:25.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:28.986 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:28:34.990 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:36.753 WARNING:teuthology.provision.fog.smithi099:timed out
2023-10-01T15:28:42.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:42.990 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T15:28:42.990 DEBUG:teuthology.orchestra.run.smithi099:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T15:28:43.244 INFO:teuthology.provision.fog.smithi099:Node is ready
2023-10-01T15:28:43.244 DEBUG:teuthology.orchestra.run.smithi099:> hostname
2023-10-01T15:28:43.303 INFO:teuthology.orchestra.run.smithi099.stdout:smithi099.front.sepia.ceph.com
2023-10-01T15:28:43.303 DEBUG:teuthology.orchestra.run.smithi099:> grep smithi099.front.sepia.ceph.com /etc/hosts
2023-10-01T15:28:43.362 INFO:teuthology.orchestra.run.smithi099.stdout:172.21.15.99 smithi099.front.sepia.ceph.com smithi099
2023-10-01T15:28:43.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-01T15:28:43.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hosts
2023-10-01T15:28:43.496 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/172.21.15.99/172.21.15.99/g' /etc/hosts
2023-10-01T15:28:43.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i -e 's/smithi099.front.sepia.ceph.com/smithi099/g' /etc/hostname
2023-10-01T15:28:43.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo hostname smithi099
2023-10-01T15:28:43.697 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-01T15:28:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T15:28:43.756 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T15:28:43.756 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T15:28:43.756 INFO:teuthology.provision.fog.smithi099:Deploy complete!
2023-10-01T15:28:43.757 DEBUG:teuthology.parallel:result is None
2023-10-01T15:28:45.178 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:28:51.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:28:54.234 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:29:00.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:29:03.325 WARNING:teuthology.provision.fog.smithi084:[Errno None] Unable to connect to port 22 on 172.21.15.84
2023-10-01T15:29:09.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:29:09.528 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-10-01T15:29:09.528 DEBUG:teuthology.orchestra.run.smithi084:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-10-01T15:29:30.290 INFO:teuthology.provision.fog.smithi084:Node is ready
2023-10-01T15:29:30.290 DEBUG:teuthology.orchestra.run.smithi084:> hostname
2023-10-01T15:29:30.312 INFO:teuthology.orchestra.run.smithi084.stdout:smithi193
2023-10-01T15:29:30.312 DEBUG:teuthology.orchestra.run.smithi084:> grep smithi193 /etc/hosts
2023-10-01T15:29:30.373 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.193 smithi193.front.sepia.ceph.com smithi193
2023-10-01T15:29:30.373 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2023-10-01T15:29:30.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi193/smithi084/g' /etc/hosts
2023-10-01T15:29:30.536 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/172.21.15.193/172.21.15.84/g' /etc/hosts
2023-10-01T15:29:30.605 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i -e 's/smithi193/smithi084/g' /etc/hostname
2023-10-01T15:29:30.674 DEBUG:teuthology.orchestra.run.smithi084:> sudo hostname smithi084
2023-10-01T15:29:30.740 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2023-10-01T15:29:30.799 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T15:29:30.800 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2023-10-01T15:29:30.800 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T15:29:30.800 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T15:29:30.800 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T15:29:30.800 INFO:teuthology.provision.fog.smithi084:Deploy complete!
2023-10-01T15:29:30.800 DEBUG:teuthology.parallel:result is None
2023-10-01T15:29:30.948 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com
2023-10-01T15:29:30.948 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T15:29:30.970 INFO:teuthology.lock.ops:Checking smithi099.front.sepia.ceph.com
2023-10-01T15:29:30.970 INFO:teuthology.lock.ops:New key found. Updating...
2023-10-01T15:29:30.987 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server
2023-10-01T15:29:30.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com'
2023-10-01T15:29:30.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:29:31.054 DEBUG:teuthology.orchestra.run.smithi084:> true
2023-10-01T15:29:31.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com'
2023-10-01T15:29:31.120 DEBUG:teuthology.orchestra.run.smithi084:> uname -m
2023-10-01T15:29:31.178 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64
2023-10-01T15:29:31.178 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release
2023-10-01T15:29:31.235 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream"
2023-10-01T15:29:31.235 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T15:29:31.236 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T15:29:31.237 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server
2023-10-01T15:29:31.261 INFO:teuthology.lock.ops:Updating [smithi099.front.sepia.ceph.com]: set os type and version on server
2023-10-01T15:29:31.261 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-01T15:29:31.262 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-10-01T15:29:31.328 DEBUG:teuthology.orchestra.run.smithi099:> true
2023-10-01T15:29:31.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com'
2023-10-01T15:29:31.461 DEBUG:teuthology.orchestra.run.smithi099:> uname -m
2023-10-01T15:29:31.520 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64
2023-10-01T15:29:31.520 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="CentOS Stream"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="8"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:ID="centos"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE="rhel fedora"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="8"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:PLATFORM_ID="platform:el8"
2023-10-01T15:29:31.578 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="CentOS Stream 8"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:ANSI_COLOR="0;31"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://centos.org/"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-10-01T15:29:31.579 INFO:teuthology.orchestra.run.smithi099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-10-01T15:29:31.579 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server
2023-10-01T15:29:31.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:29:31.692 INFO:teuthology.dispatcher.supervisor:Running job 7408203
2023-10-01T15:29:31.692 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408203 --name yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/asok_dump_tree} -- /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408203/orig.config.yaml
2023-10-01T15:29:31.695 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408203
2023-10-01T15:29:31.695 INFO:teuthology.dispatcher.supervisor:Job PID: 940709
2023-10-01T15:29:31.696 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-10-01T15:31:31.794 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:33:31.952 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:35:32.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:37:32.283 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:39:32.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:41:32.619 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:43:32.795 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:45:32.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:47:33.108 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:49:33.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:51:34.071 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:53:34.204 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:55:34.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:57:34.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T15:59:34.683 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:01:34.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:03:35.014 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:05:35.187 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:07:35.359 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:09:35.523 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:11:35.695 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:13:35.858 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:15:36.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:17:36.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:19:36.366 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:21:36.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:23:36.712 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:25:36.879 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:27:37.051 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:29:37.215 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:31:37.379 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:33:37.555 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:35:37.727 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:37:37.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:39:38.062 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:41:38.231 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:43:38.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:45:38.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:47:38.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:49:38.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:51:39.002 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:53:39.167 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:55:39.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:57:39.476 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T16:59:39.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:01:39.821 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:03:39.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-10-01T17:03:40.055 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2023-10-01T17:03:40.159 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-10-01T17:03:40.159 INFO:teuthology.nuke:Checking targets against current locks
2023-10-01T17:03:40.208 DEBUG:teuthology.nuke:shortname: smithi084
2023-10-01T17:03:40.209 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T17:03:40.227 DEBUG:teuthology.nuke:shortname: smithi099
2023-10-01T17:03:40.227 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-10-01T17:03:40.232 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 15:21:28.317505', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBALi2XRyH6KTa4zxTIOL2c/xFQzBlQ2jUeoe44+k346k/C8pjBd/6ReC8nn4qGJOkGVpze3rvRCObV8RszE71PU='}
2023-10-01T17:03:40.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-01_15:20:09-fs-wip-yuri3-testing-2023-10-01-0603-quincy-distro-default-smithi/7408203', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-01 15:21:28.316112', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJzAg6aQnlvN+xvNukDjhNE3LaINlqNbnouBlsq6w8yVH1ze3SqyxVTI5hA/mUu4uj8X6HC8Qzk3hslrPAdTBQg='}
2023-10-01T17:03:40.282 INFO:teuthology.orchestra.console.smithi084:Power off
2023-10-01T17:03:40.282 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:03:40.296 INFO:teuthology.orchestra.console.smithi099:Power off
2023-10-01T17:03:40.297 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-10-01T17:03:40.307 DEBUG:teuthology.orchestra.console.smithi084:power off output: Chassis Power Control: Down/Off
2023-10-01T17:03:40.307 DEBUG:teuthology.orchestra.console.smithi084:pexpect command: ipmitool -H smithi084.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:03:40.316 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off
2023-10-01T17:03:40.316 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-10-01T17:03:40.326 DEBUG:teuthology.orchestra.console.smithi084:check power output: Chassis Power is off
2023-10-01T17:03:40.336 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off
2023-10-01T17:03:40.427 INFO:teuthology.orchestra.console.smithi084:Power off completed
2023-10-01T17:03:40.437 INFO:teuthology.orchestra.console.smithi099:Power off completed
2023-10-01T17:03:40.578 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com
2023-10-01T17:03:40.590 INFO:teuthology.lock.ops:unlocked: smithi099.front.sepia.ceph.com