2023-09-06T08:02:46.127 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc
2023-09-06T08:02:46.128 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:02:46.296 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f3961152d00>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f3961c44670>, signals=[15])
2023-09-06T08:02:46.297 INFO:teuthology.lock.ops:Start node 'smithi007.front.sepia.ceph.com' reimaging
2023-09-06T08:02:46.297 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: reset os type and version on server
2023-09-06T08:02:46.298 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-09-06T08:02:46.319 INFO:teuthology.lock.ops:Start node 'smithi022.front.sepia.ceph.com' reimaging
2023-09-06T08:02:46.320 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: reset os type and version on server
2023-09-06T08:02:46.320 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2023-09-06T08:02:46.322 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /host {"name": "smithi007"}
2023-09-06T08:02:46.344 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging
2023-09-06T08:02:46.345 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server
2023-09-06T08:02:46.346 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-09-06T08:02:46.348 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /host {"name": "smithi022"}
2023-09-06T08:02:46.369 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"}
2023-09-06T08:02:46.397 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-06T08:02:46.423 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-06T08:02:46.442 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_8.stream"}
2023-09-06T08:02:46.446 DEBUG:teuthology.provision.fog.smithi007:Requesting image smithi_centos_8.stream (ID 3)
2023-09-06T08:02:46.447 DEBUG:teuthology.provision.fog.smithi007:FOG request: PUT /host/113 {"imageID": 3}
2023-09-06T08:02:46.465 DEBUG:teuthology.provision.fog.smithi022:Requesting image smithi_centos_8.stream (ID 3)
2023-09-06T08:02:46.465 DEBUG:teuthology.provision.fog.smithi022:FOG request: PUT /host/128 {"imageID": 3}
2023-09-06T08:02:46.492 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_8.stream (ID 3)
2023-09-06T08:02:46.492 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 3}
2023-09-06T08:02:46.499 INFO:teuthology.provision.fog.smithi007:Scheduling deploy of centos 8.stream
2023-09-06T08:02:46.499 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:02:46.524 INFO:teuthology.provision.fog.smithi022:Scheduling deploy of centos 8.stream
2023-09-06T08:02:46.525 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:02:46.548 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 8.stream
2023-09-06T08:02:46.549 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:02:46.575 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /tasktype {"name": "deploy"}
2023-09-06T08:02:46.598 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /tasktype {"name": "deploy"}
2023-09-06T08:02:46.617 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"}
2023-09-06T08:02:46.621 DEBUG:teuthology.provision.fog.smithi007:FOG request: POST /host/113/task {"taskTypeID": 1}
2023-09-06T08:02:46.639 DEBUG:teuthology.provision.fog.smithi022:FOG request: POST /host/128/task {"taskTypeID": 1}
2023-09-06T08:02:46.656 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1}
2023-09-06T08:02:46.778 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:02:46.789 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:02:46.793 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:02:46.897 INFO:teuthology.orchestra.console.smithi007:Power off
2023-09-06T08:02:46.898 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-06T08:02:46.911 INFO:teuthology.orchestra.console.smithi096:Power off
2023-09-06T08:02:46.912 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-06T08:02:46.925 INFO:teuthology.orchestra.console.smithi022:Power off
2023-09-06T08:02:46.926 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-09-06T08:02:46.933 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off
2023-09-06T08:02:46.934 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:46.941 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off
2023-09-06T08:02:46.941 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:46.949 DEBUG:teuthology.orchestra.console.smithi022:power off output: Chassis Power Control: Down/Off
2023-09-06T08:02:46.950 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:46.957 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2023-09-06T08:02:46.960 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-09-06T08:02:46.969 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-06T08:02:47.059 INFO:teuthology.orchestra.console.smithi096:Power off completed
2023-09-06T08:02:47.061 INFO:teuthology.orchestra.console.smithi007:Power off completed
2023-09-06T08:02:47.070 INFO:teuthology.orchestra.console.smithi022:Power off completed
2023-09-06T08:02:47.159 INFO:teuthology.orchestra.console.smithi096:Power on
2023-09-06T08:02:47.160 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-06T08:02:47.169 INFO:teuthology.orchestra.console.smithi007:Power on
2023-09-06T08:02:47.170 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-06T08:02:47.177 INFO:teuthology.orchestra.console.smithi022:Power on
2023-09-06T08:02:47.177 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-09-06T08:02:47.185 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On
2023-09-06T08:02:47.186 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:47.195 DEBUG:teuthology.orchestra.console.smithi007:power on output: Chassis Power Control: Up/On
2023-09-06T08:02:47.196 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:47.204 DEBUG:teuthology.orchestra.console.smithi022:power on output: Chassis Power Control: Up/On
2023-09-06T08:02:47.204 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:47.213 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off
2023-09-06T08:02:47.216 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-09-06T08:02:47.225 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is off
2023-09-06T08:02:51.218 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:51.224 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:51.232 DEBUG:teuthology.orchestra.console.smithi022:pexpect command: ipmitool -H smithi022.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:51.327 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on
2023-09-06T08:02:51.334 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off
2023-09-06T08:02:51.341 DEBUG:teuthology.orchestra.console.smithi022:check power output: Chassis Power is on
2023-09-06T08:02:51.428 INFO:teuthology.orchestra.console.smithi096:Power on completed
2023-09-06T08:02:51.442 INFO:teuthology.orchestra.console.smithi022:Power on completed
2023-09-06T08:02:51.531 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish
2023-09-06T08:02:51.531 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:02:51.543 INFO:teuthology.provision.fog.smithi022:Waiting for deploy to finish
2023-09-06T08:02:51.543 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:02:55.338 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-09-06T08:02:55.447 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on
2023-09-06T08:02:55.548 INFO:teuthology.orchestra.console.smithi007:Power on completed
2023-09-06T08:02:55.649 INFO:teuthology.provision.fog.smithi007:Waiting for deploy to finish
2023-09-06T08:02:55.649 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:03:06.638 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:03:06.640 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:03:10.735 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:03:21.734 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:03:21.736 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:03:25.826 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:03:36.834 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:03:36.835 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:03:40.914 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:03:51.932 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:03:51.933 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:03:56.006 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:04:07.018 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:04:07.020 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:04:11.082 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:04:22.102 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:04:22.104 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:04:26.174 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:04:37.193 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:04:37.195 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:04:41.258 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:04:52.274 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:04:52.281 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:04:56.326 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:05:07.350 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:05:07.355 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:05:11.426 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:05:22.434 DEBUG:teuthology.provision.fog.smithi022:FOG request: GET /task/active None
2023-09-06T08:05:22.436 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:05:22.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:25.566 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-06T08:05:26.507 DEBUG:teuthology.provision.fog.smithi007:FOG request: GET /task/active None
2023-09-06T08:05:26.583 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:29.658 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:05:31.570 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:34.653 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-06T08:05:35.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:37.508 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None
2023-09-06T08:05:37.573 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:38.718 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:05:40.634 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:05:40.654 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:43.706 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-06T08:05:44.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:46.637 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:47.806 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:05:49.694 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:05:49.707 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:52.766 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-06T08:05:53.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:55.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:56.862 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:05:58.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:05:58.784 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:06:01.850 WARNING:teuthology.provision.fog.smithi022:[Errno None] Unable to connect to port 22 on 172.21.15.22
2023-09-06T08:06:02.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:04.786 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:05.950 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:06:07.853 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:07.866 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:06:11.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:13.869 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:15.038 WARNING:teuthology.provision.fog.smithi007:[Errno None] Unable to connect to port 22 on 172.21.15.7
2023-09-06T08:06:16.926 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:06:21.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:22.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:06:26.010 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96
2023-09-06T08:06:32.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:07.890 WARNING:teuthology.provision.fog.smithi022:timed out
2023-09-06T08:07:13.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:14.120 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-06T08:07:14.121 DEBUG:teuthology.orchestra.run.smithi022:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-06T08:07:14.349 INFO:teuthology.provision.fog.smithi022:Node is ready
2023-09-06T08:07:14.349 DEBUG:teuthology.orchestra.run.smithi022:> hostname
2023-09-06T08:07:14.412 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022.front.sepia.ceph.com
2023-09-06T08:07:14.413 DEBUG:teuthology.orchestra.run.smithi022:> grep smithi022.front.sepia.ceph.com /etc/hosts
2023-09-06T08:07:14.475 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022
2023-09-06T08:07:14.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-09-06T08:07:14.571 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hosts
2023-09-06T08:07:14.602 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/172.21.15.22/172.21.15.22/g' /etc/hosts
2023-09-06T08:07:14.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i -e 's/smithi022.front.sepia.ceph.com/smithi022/g' /etc/hostname
2023-09-06T08:07:14.746 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname smithi022
2023-09-06T08:07:14.818 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2023-09-06T08:07:14.880 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream"
2023-09-06T08:07:14.880 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8"
2023-09-06T08:07:14.880 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos"
2023-09-06T08:07:14.881 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:14.881 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8"
2023-09-06T08:07:14.881 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:14.881 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:14.881 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:14.882 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:14.882 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:14.882 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:14.882 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:14.883 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:14.883 INFO:teuthology.provision.fog.smithi022:Deploy complete!
2023-09-06T08:07:14.885 DEBUG:teuthology.parallel:result is None
2023-09-06T08:07:21.051 WARNING:teuthology.provision.fog.smithi007:timed out
2023-09-06T08:07:27.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:27.297 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-06T08:07:27.297 DEBUG:teuthology.orchestra.run.smithi007:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-06T08:07:27.541 INFO:teuthology.provision.fog.smithi007:Node is ready
2023-09-06T08:07:27.541 DEBUG:teuthology.orchestra.run.smithi007:> hostname
2023-09-06T08:07:27.563 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007.front.sepia.ceph.com
2023-09-06T08:07:27.563 DEBUG:teuthology.orchestra.run.smithi007:> grep smithi007.front.sepia.ceph.com /etc/hosts
2023-09-06T08:07:27.623 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7 smithi007.front.sepia.ceph.com smithi007
2023-09-06T08:07:27.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-09-06T08:07:27.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hosts
2023-09-06T08:07:27.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/172.21.15.7/172.21.15.7/g' /etc/hosts
2023-09-06T08:07:27.829 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i -e 's/smithi007.front.sepia.ceph.com/smithi007/g' /etc/hostname
2023-09-06T08:07:27.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname smithi007
2023-09-06T08:07:27.972 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-09-06T08:07:28.031 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream"
2023-09-06T08:07:28.031 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8"
2023-09-06T08:07:28.031 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos"
2023-09-06T08:07:28.032 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:28.032 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8"
2023-09-06T08:07:28.032 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:28.032 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:28.032 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:28.033 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:28.033 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:28.033 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:28.033 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:28.033 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:28.034 INFO:teuthology.provision.fog.smithi007:Deploy complete!
2023-09-06T08:07:28.034 DEBUG:teuthology.parallel:result is None
2023-09-06T08:07:32.017 WARNING:teuthology.provision.fog.smithi096:timed out
2023-09-06T08:07:38.018 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:38.222 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-09-06T08:07:38.223 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-09-06T08:07:38.500 INFO:teuthology.provision.fog.smithi096:Node is ready
2023-09-06T08:07:38.500 DEBUG:teuthology.orchestra.run.smithi096:> hostname
2023-09-06T08:07:38.520 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com
2023-09-06T08:07:38.521 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts
2023-09-06T08:07:38.581 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096
2023-09-06T08:07:38.581 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-09-06T08:07:38.683 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts
2023-09-06T08:07:38.713 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts
2023-09-06T08:07:38.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname
2023-09-06T08:07:38.850 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096
2023-09-06T08:07:38.918 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-09-06T08:07:38.975 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2023-09-06T08:07:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2023-09-06T08:07:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2023-09-06T08:07:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2023-09-06T08:07:38.976 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:38.977 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:38.977 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:38.977 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:38.977 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:38.977 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:38.978 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:38.978 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:38.978 INFO:teuthology.provision.fog.smithi096:Deploy complete!
2023-09-06T08:07:38.979 DEBUG:teuthology.parallel:result is None
2023-09-06T08:07:39.195 INFO:teuthology.lock.ops:Checking smithi007.front.sepia.ceph.com
2023-09-06T08:07:39.196 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-06T08:07:39.215 INFO:teuthology.lock.ops:Checking smithi022.front.sepia.ceph.com
2023-09-06T08:07:39.216 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-06T08:07:39.232 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com
2023-09-06T08:07:39.232 INFO:teuthology.lock.ops:New key found. Updating...
2023-09-06T08:07:39.249 INFO:teuthology.lock.ops:Updating [smithi007.front.sepia.ceph.com]: set os type and version on server
2023-09-06T08:07:39.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-09-06T08:07:39.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:39.320 DEBUG:teuthology.orchestra.run.smithi007:> true
2023-09-06T08:07:39.391 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com'
2023-09-06T08:07:39.392 DEBUG:teuthology.orchestra.run.smithi007:> uname -m
2023-09-06T08:07:39.454 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64
2023-09-06T08:07:39.454 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release
2023-09-06T08:07:39.515 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream"
2023-09-06T08:07:39.515 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8"
2023-09-06T08:07:39.515 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos"
2023-09-06T08:07:39.516 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:39.516 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8"
2023-09-06T08:07:39.516 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:39.516 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:39.516 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:39.517 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:39.517 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:39.517 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:39.517 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:39.518 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:39.518 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server
2023-09-06T08:07:39.540 INFO:teuthology.lock.ops:Updating [smithi022.front.sepia.ceph.com]: set os type and version on server
2023-09-06T08:07:39.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-09-06T08:07:39.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:39.609 DEBUG:teuthology.orchestra.run.smithi022:> true
2023-09-06T08:07:39.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com'
2023-09-06T08:07:39.746 DEBUG:teuthology.orchestra.run.smithi022:> uname -m
2023-09-06T08:07:39.806 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64
2023-09-06T08:07:39.806 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release
2023-09-06T08:07:39.866 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream"
2023-09-06T08:07:39.866 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="8"
2023-09-06T08:07:39.866 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos"
2023-09-06T08:07:39.866 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:39.867 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="8"
2023-09-06T08:07:39.867 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:39.867 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:39.867 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:39.867 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:39.868 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:39.868 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:39.868 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:39.868 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:39.869 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server
2023-09-06T08:07:39.890 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server
2023-09-06T08:07:39.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-09-06T08:07:39.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-09-06T08:07:39.957 DEBUG:teuthology.orchestra.run.smithi096:> true
2023-09-06T08:07:40.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com'
2023-09-06T08:07:40.026 DEBUG:teuthology.orchestra.run.smithi096:> uname -m
2023-09-06T08:07:40.084 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64
2023-09-06T08:07:40.085 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release
2023-09-06T08:07:40.143 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream"
2023-09-06T08:07:40.143 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8"
2023-09-06T08:07:40.143 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos"
2023-09-06T08:07:40.144 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora"
2023-09-06T08:07:40.144 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8"
2023-09-06T08:07:40.144 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8"
2023-09-06T08:07:40.144 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 8"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2023-09-06T08:07:40.145 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-09-06T08:07:40.146 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server
2023-09-06T08:07:40.165 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:07:40.265 INFO:teuthology.dispatcher.supervisor:Running job 7389399
2023-09-06T08:07:40.266 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-09-05_23:32:56-fs-wip-batrick-testing-20230905.192950-distro-default-smithi/7389399 --name pdonnell-2023-09-05_23:32:56-fs-wip-batrick-testing-20230905.192950-distro-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8 clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/pdonnell-2023-09-05_23:32:56-fs-wip-batrick-testing-20230905.192950-distro-default-smithi/7389399/orig.config.yaml
2023-09-06T08:07:40.269 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-09-05_23:32:56-fs-wip-batrick-testing-20230905.192950-distro-default-smithi/7389399
2023-09-06T08:07:40.269 INFO:teuthology.dispatcher.supervisor:Job PID: 3023545
2023-09-06T08:07:40.270 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-09-06T08:09:40.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:11:40.535 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:13:40.707 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:15:40.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:17:41.047 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:19:41.227 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:21:41.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:23:41.545 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-09-06T08:23:41.616 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120