2023-07-26T22:00:28.408 INFO:root:teuthology version: 0.0.1.dev160+g407880c
2023-07-26T22:00:28.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:00:28.410 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:00:28.597 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f5b25703df0>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f5b25083310>, signals=[15])
2023-07-26T22:00:28.598 INFO:teuthology.lock.ops:Start node 'smithi023.front.sepia.ceph.com' reimaging
2023-07-26T22:00:28.599 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T22:00:28.599 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-07-26T22:00:28.623 INFO:teuthology.lock.ops:Start node 'smithi060.front.sepia.ceph.com' reimaging
2023-07-26T22:00:28.624 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T22:00:28.624 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2023-07-26T22:00:28.627 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /host {"name": "smithi023"}
2023-07-26T22:00:28.647 INFO:teuthology.lock.ops:Start node 'smithi092.front.sepia.ceph.com' reimaging
2023-07-26T22:00:28.648 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: reset os type and version on server
2023-07-26T22:00:28.648 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-07-26T22:00:28.650 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /host {"name": "smithi060"}
2023-07-26T22:00:28.673 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /host {"name": "smithi092"}
2023-07-26T22:00:28.706 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-26T22:00:28.723 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-26T22:00:28.737 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /image {"name": "smithi_centos_9.stream"}
2023-07-26T22:00:28.749 DEBUG:teuthology.provision.fog.smithi023:Requesting image smithi_centos_9.stream (ID 10)
2023-07-26T22:00:28.749 DEBUG:teuthology.provision.fog.smithi023:FOG request: PUT /host/129 {"imageID": 10}
2023-07-26T22:00:28.769 DEBUG:teuthology.provision.fog.smithi060:Requesting image smithi_centos_9.stream (ID 10)
2023-07-26T22:00:28.769 DEBUG:teuthology.provision.fog.smithi060:FOG request: PUT /host/165 {"imageID": 10}
2023-07-26T22:00:28.781 DEBUG:teuthology.provision.fog.smithi092:Requesting image smithi_centos_9.stream (ID 10)
2023-07-26T22:00:28.781 DEBUG:teuthology.provision.fog.smithi092:FOG request: PUT /host/197 {"imageID": 10}
2023-07-26T22:00:28.788 INFO:teuthology.provision.fog.smithi023:Scheduling deploy of centos 9.stream
2023-07-26T22:00:28.789 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:00:28.812 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of centos 9.stream
2023-07-26T22:00:28.812 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:00:28.817 INFO:teuthology.provision.fog.smithi092:Scheduling deploy of centos 9.stream
2023-07-26T22:00:28.817 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:00:28.845 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T22:00:28.873 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T22:00:28.878 DEBUG:teuthology.provision.fog.smithi023:FOG request: POST /host/129/task {"taskTypeID": 1}
2023-07-26T22:00:28.885 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /tasktype {"name": "deploy"}
2023-07-26T22:00:28.911 DEBUG:teuthology.provision.fog.smithi060:FOG request: POST /host/165/task {"taskTypeID": 1}
2023-07-26T22:00:28.928 DEBUG:teuthology.provision.fog.smithi092:FOG request: POST /host/197/task {"taskTypeID": 1}
2023-07-26T22:00:28.948 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:00:28.968 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:00:28.993 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:00:29.048 INFO:teuthology.orchestra.console:Power off smithi023
2023-07-26T22:00:29.049 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T22:00:29.077 INFO:teuthology.orchestra.console:Power off smithi060
2023-07-26T22:00:29.078 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T22:00:29.091 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T22:00:29.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:29.106 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T22:00:29.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:29.125 INFO:teuthology.orchestra.console:Power off smithi092
2023-07-26T22:00:29.126 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-07-26T22:00:29.137 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:29.139 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T22:00:29.153 DEBUG:teuthology.orchestra.console:power off output: Chassis Power Control: Down/Off
2023-07-26T22:00:29.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:29.178 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:29.239 INFO:teuthology.orchestra.console:Power off for smithi023 completed
2023-07-26T22:00:29.280 INFO:teuthology.orchestra.console:Power off for smithi092 completed
2023-07-26T22:00:29.340 INFO:teuthology.orchestra.console:Power on smithi023
2023-07-26T22:00:29.341 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T22:00:29.363 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T22:00:29.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:29.381 INFO:teuthology.orchestra.console:Power on smithi092
2023-07-26T22:00:29.381 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T22:00:29.390 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:29.401 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T22:00:29.401 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:29.425 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:33.144 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:33.254 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T22:00:33.391 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi023.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:33.427 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:33.502 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T22:00:33.603 INFO:teuthology.orchestra.console:Power on for smithi023 completed
2023-07-26T22:00:33.704 INFO:teuthology.provision.fog.smithi023:Waiting for deploy to finish
2023-07-26T22:00:33.705 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:00:38.713 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:38.721 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T22:00:38.822 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:38.923 INFO:teuthology.orchestra.console:Power off for smithi060 completed
2023-07-26T22:00:39.023 INFO:teuthology.orchestra.console:Power on smithi060
2023-07-26T22:00:39.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-07-26T22:00:39.044 DEBUG:teuthology.orchestra.console:power on output: Chassis Power Control: Up/On
2023-07-26T22:00:39.045 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:39.065 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:42.724 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:43.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:43.178 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is off
2023-07-26T22:00:43.835 DEBUG:teuthology.orchestra.console:check power output: 
2023-07-26T22:00:47.180 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:47.291 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T22:00:47.392 INFO:teuthology.orchestra.console:Power on for smithi060 completed
2023-07-26T22:00:47.493 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish
2023-07-26T22:00:47.493 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:00:57.505 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-07-26T22:00:57.514 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:01:07.526 DEBUG:teuthology.orchestra.console:check power output: Chassis Power is on
2023-07-26T22:01:07.627 INFO:teuthology.orchestra.console:Power on for smithi092 completed
2023-07-26T22:01:07.727 INFO:teuthology.provision.fog.smithi092:Waiting for deploy to finish
2023-07-26T22:01:07.728 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:01:22.600 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:01:22.602 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:01:32.613 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:01:52.634 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:01:57.640 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:01:57.641 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:02:13.008 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:02:13.010 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:02:13.011 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:02:33.104 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:02:33.105 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:02:33.106 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:02:50.608 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:02:50.610 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:02:55.608 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:03:10.728 DEBUG:teuthology.provision.fog.smithi092:FOG request: GET /task/active None
2023-07-26T22:03:10.729 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:03:10.730 DEBUG:teuthology.provision.fog.smithi060:FOG request: GET /task/active None
2023-07-26T22:03:25.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:30.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:35.824 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-26T22:03:38.899 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-26T22:03:41.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:44.880 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-26T22:03:44.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:50.824 DEBUG:teuthology.provision.fog.smithi023:FOG request: GET /task/active None
2023-07-26T22:03:50.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:50.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:52.976 WARNING:teuthology.provision.fog.smithi060:[Errno None] Unable to connect to port 22 on 172.21.15.60
2023-07-26T22:03:53.936 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-26T22:03:53.968 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:03:58.980 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:59.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:03:59.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:02.992 WARNING:teuthology.provision.fog.smithi092:[Errno None] Unable to connect to port 22 on 172.21.15.92
2023-07-26T22:04:03.024 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:04:08.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:09.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:12.080 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:04:18.085 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:21.136 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:04:27.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:35.216 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:04:41.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:04:49.296 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:04:55.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:05:00.310 WARNING:teuthology.provision.fog.smithi060:timed out
2023-07-26T22:05:03.376 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:05:06.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:05:06.522 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T22:05:06.523 DEBUG:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T22:05:06.874 INFO:teuthology.provision.fog.smithi060:Node is ready
2023-07-26T22:05:06.874 DEBUG:teuthology.orchestra.run.smithi060:> hostname
2023-07-26T22:05:06.890 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com
2023-07-26T22:05:06.890 DEBUG:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts
2023-07-26T22:05:06.947 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060
2023-07-26T22:05:06.948 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-07-26T22:05:07.079 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts
2023-07-26T22:05:07.111 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts
2023-07-26T22:05:07.184 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname
2023-07-26T22:05:07.257 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname smithi060
2023-07-26T22:05:07.326 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2023-07-26T22:05:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream"
2023-07-26T22:05:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9"
2023-07-26T22:05:07.380 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2023-07-26T22:05:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:05:07.382 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:05:07.383 INFO:teuthology.provision.fog.smithi060:Deploy complete!
2023-07-26T22:05:07.384 DEBUG:teuthology.parallel:result is None
2023-07-26T22:05:09.002 WARNING:teuthology.provision.fog.smithi092:timed out
2023-07-26T22:05:09.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:05:12.496 WARNING:teuthology.provision.fog.smithi023:[Errno None] Unable to connect to port 22 on 172.21.15.23
2023-07-26T22:05:15.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:05:20.009 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:05:25.201 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T22:05:25.201 DEBUG:teuthology.orchestra.run.smithi092:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T22:05:25.553 INFO:teuthology.provision.fog.smithi092:Node is ready
2023-07-26T22:05:25.554 DEBUG:teuthology.orchestra.run.smithi092:> hostname
2023-07-26T22:05:25.570 INFO:teuthology.orchestra.run.smithi092.stdout:smithi092.front.sepia.ceph.com
2023-07-26T22:05:25.570 DEBUG:teuthology.orchestra.run.smithi092:> grep smithi092.front.sepia.ceph.com /etc/hosts
2023-07-26T22:05:25.627 INFO:teuthology.orchestra.run.smithi092.stdout:172.21.15.92 smithi092.front.sepia.ceph.com smithi092
2023-07-26T22:05:25.628 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-07-26T22:05:25.749 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hosts
2023-07-26T22:05:25.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/172.21.15.92/172.21.15.92/g' /etc/hosts
2023-07-26T22:05:25.854 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i -e 's/smithi092.front.sepia.ceph.com/smithi092/g' /etc/hostname
2023-07-26T22:05:25.925 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname smithi092
2023-07-26T22:05:25.994 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-07-26T22:05:26.051 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-07-26T22:05:26.051 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9"
2023-07-26T22:05:26.051 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-07-26T22:05:26.051 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:05:26.051 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:05:26.052 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:05:26.053 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:05:26.053 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:05:26.053 INFO:teuthology.provision.fog.smithi092:Deploy complete!
2023-07-26T22:05:26.053 DEBUG:teuthology.parallel:result is None
2023-07-26T22:05:56.693 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-07-26T22:05:56.694 DEBUG:teuthology.orchestra.run.smithi023:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-07-26T22:06:07.034 INFO:teuthology.provision.fog.smithi023:Node is ready
2023-07-26T22:06:07.034 DEBUG:teuthology.orchestra.run.smithi023:> hostname
2023-07-26T22:06:07.093 INFO:teuthology.orchestra.run.smithi023.stdout:smithi197
2023-07-26T22:06:07.093 DEBUG:teuthology.orchestra.run.smithi023:> grep smithi197 /etc/hosts
2023-07-26T22:06:07.151 INFO:teuthology.orchestra.run.smithi023.stdout:172.21.15.197 smithi197.front.sepia.ceph.com smithi197
2023-07-26T22:06:07.151 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-07-26T22:06:07.287 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi197/smithi023/g' /etc/hosts
2023-07-26T22:06:07.323 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/172.21.15.197/172.21.15.23/g' /etc/hosts
2023-07-26T22:06:07.397 DEBUG:teuthology.orchestra.run.smithi023:> sudo sed -i -e 's/smithi197/smithi023/g' /etc/hostname
2023-07-26T22:06:07.470 DEBUG:teuthology.orchestra.run.smithi023:> sudo hostname smithi023
2023-07-26T22:06:07.542 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-07-26T22:06:07.598 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2023-07-26T22:06:07.598 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9"
2023-07-26T22:06:07.598 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2023-07-26T22:06:07.598 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:06:07.598 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:06:07.599 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:06:07.600 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:06:07.600 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:06:07.600 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:06:07.600 INFO:teuthology.provision.fog.smithi023:Deploy complete!
2023-07-26T22:06:07.601 DEBUG:teuthology.parallel:result is None
2023-07-26T22:06:27.838 INFO:teuthology.lock.ops:Checking smithi023.front.sepia.ceph.com
2023-07-26T22:06:27.838 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-26T22:06:27.869 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com
2023-07-26T22:06:27.870 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-26T22:06:27.894 INFO:teuthology.lock.ops:Checking smithi092.front.sepia.ceph.com
2023-07-26T22:06:27.894 INFO:teuthology.lock.ops:New key found. Updating...
2023-07-26T22:06:27.921 INFO:teuthology.lock.ops:Updating [smithi023.front.sepia.ceph.com]: set os type and version on server
2023-07-26T22:06:27.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-07-26T22:06:27.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:06:28.022 DEBUG:teuthology.orchestra.run.smithi023:> true
2023-07-26T22:06:28.207 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi023.front.sepia.ceph.com'
2023-07-26T22:06:28.208 DEBUG:teuthology.orchestra.run.smithi023:> uname -m
2023-07-26T22:06:28.262 INFO:teuthology.orchestra.run.smithi023.stdout:x86_64
2023-07-26T22:06:28.262 DEBUG:teuthology.orchestra.run.smithi023:> cat /etc/os-release
2023-07-26T22:06:28.317 INFO:teuthology.orchestra.run.smithi023.stdout:NAME="CentOS Stream"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION="9"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:ID="centos"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:VERSION_ID="9"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:06:28.318 INFO:teuthology.orchestra.run.smithi023.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:ANSI_COLOR="0;31"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:06:28.319 INFO:teuthology.orchestra.run.smithi023.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:06:28.320 INFO:teuthology.lock.ops:Updating smithi023.front.sepia.ceph.com on lock server
2023-07-26T22:06:28.345 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server
2023-07-26T22:06:28.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com'
2023-07-26T22:06:28.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:06:28.446 DEBUG:teuthology.orchestra.run.smithi060:> true
2023-07-26T22:06:28.635 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com'
2023-07-26T22:06:28.636 DEBUG:teuthology.orchestra.run.smithi060:> uname -m
2023-07-26T22:06:28.690 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64
2023-07-26T22:06:28.691 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release
2023-07-26T22:06:28.747 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream"
2023-07-26T22:06:28.747 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9"
2023-07-26T22:06:28.747 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos"
2023-07-26T22:06:28.747 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:06:28.748 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:06:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:06:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:06:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:06:28.749 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:06:28.749 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server
2023-07-26T22:06:28.770 INFO:teuthology.lock.ops:Updating [smithi092.front.sepia.ceph.com]: set os type and version on server
2023-07-26T22:06:28.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-07-26T22:06:28.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-07-26T22:06:28.856 DEBUG:teuthology.orchestra.run.smithi092:> true
2023-07-26T22:06:29.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com'
2023-07-26T22:06:29.032 DEBUG:teuthology.orchestra.run.smithi092:> uname -m
2023-07-26T22:06:29.087 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64
2023-07-26T22:06:29.087 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release
2023-07-26T22:06:29.142 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream"
2023-07-26T22:06:29.143 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9"
2023-07-26T22:06:29.143 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos"
2023-07-26T22:06:29.143 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora"
2023-07-26T22:06:29.143 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9"
2023-07-26T22:06:29.143 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/"
2023-07-26T22:06:29.144 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-07-26T22:06:29.145 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2023-07-26T22:06:29.145 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2023-07-26T22:06:29.145 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server
2023-07-26T22:06:34.177 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:06:34.177 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:06:39.277 INFO:teuthology.dispatcher.supervisor:Running job 7353165
2023-07-26T22:06:39.278 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_407880c6d3fb77318fff01c863715090f9c2de69/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353165 --name yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_latest clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} -- /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353165/orig.config.yaml
2023-07-26T22:06:39.281 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-07-26_14:34:38-fs-reef-release-distro-default-smithi/7353165
2023-07-26T22:06:39.281 INFO:teuthology.dispatcher.supervisor:Job PID: 30457
2023-07-26T22:06:39.282 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-07-26T22:08:39.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:08:39.381 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:10:44.561 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:10:44.561 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:12:49.732 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:12:49.733 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:14:54.889 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:14:54.890 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:17:00.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:17:00.066 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:19:05.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:19:05.237 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:21:10.408 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-07-26T22:21:10.409 DEBUG:urllib3.util.retry:Converted retries value: 10 -> Retry(total=10, connect=None, read=None, redirect=None, status=None)
2023-07-26T22:21:10.477 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120