2023-08-30T22:48:41.601 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-30T22:48:41.602 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:48:41.749 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa9b425f670>, signals=[15]) 2023-08-30T22:48:41.750 INFO:teuthology.lock.ops:Start node 'smithi094.front.sepia.ceph.com' reimaging 2023-08-30T22:48:41.750 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:48:41.751 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-08-30T22:48:41.775 INFO:teuthology.lock.ops:Start node 'smithi159.front.sepia.ceph.com' reimaging 2023-08-30T22:48:41.776 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: reset os type and version on server 2023-08-30T22:48:41.776 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-30T22:48:41.777 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /host {"name": "smithi094"} 2023-08-30T22:48:41.800 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /host {"name": "smithi159"} 2023-08-30T22:48:41.856 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:48:41.882 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-30T22:48:41.905 DEBUG:teuthology.provision.fog.smithi094:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:48:41.906 DEBUG:teuthology.provision.fog.smithi094:FOG request: PUT /host/199 {"imageID": 3} 2023-08-30T22:48:41.921 DEBUG:teuthology.provision.fog.smithi159:Requesting image smithi_centos_8.stream (ID 3) 2023-08-30T22:48:41.922 DEBUG:teuthology.provision.fog.smithi159:FOG request: PUT /host/264 {"imageID": 3} 2023-08-30T22:48:41.957 INFO:teuthology.provision.fog.smithi094:Scheduling deploy of centos 8.stream 2023-08-30T22:48:41.957 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:48:41.972 INFO:teuthology.provision.fog.smithi159:Scheduling deploy of centos 8.stream 2023-08-30T22:48:41.972 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:48:42.045 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:48:42.062 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /tasktype {"name": "deploy"} 2023-08-30T22:48:42.083 DEBUG:teuthology.provision.fog.smithi094:FOG request: POST /host/199/task {"taskTypeID": 1} 2023-08-30T22:48:42.098 DEBUG:teuthology.provision.fog.smithi159:FOG request: POST /host/264/task {"taskTypeID": 1} 2023-08-30T22:48:42.139 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:48:42.158 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:48:42.267 INFO:teuthology.orchestra.console.smithi094:Power off 2023-08-30T22:48:42.268 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:48:42.288 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-08-30T22:48:42.289 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:42.308 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-30T22:48:42.308 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T22:48:42.316 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-08-30T22:48:42.328 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-30T22:48:42.329 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:42.351 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-30T22:48:42.417 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-08-30T22:48:42.453 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-30T22:48:42.519 INFO:teuthology.orchestra.console.smithi094:Power on 2023-08-30T22:48:42.519 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:48:42.541 DEBUG:teuthology.orchestra.console.smithi094:power on output: Chassis Power Control: Up/On 2023-08-30T22:48:42.542 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:42.555 INFO:teuthology.orchestra.console.smithi159:Power on 2023-08-30T22:48:42.555 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-30T22:48:42.564 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-08-30T22:48:42.575 DEBUG:teuthology.orchestra.console.smithi159:power on output: Chassis Power Control: Up/On 2023-08-30T22:48:42.576 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:42.598 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-30T22:48:46.566 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:46.600 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:46.675 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-08-30T22:48:46.710 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-30T22:48:50.678 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:50.711 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T22:48:50.822 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2023-08-30T22:48:50.882 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2023-08-30T22:48:50.923 INFO:teuthology.orchestra.console.smithi159:Power on completed 2023-08-30T22:48:50.984 INFO:teuthology.orchestra.console.smithi094:Power on completed 2023-08-30T22:48:51.025 INFO:teuthology.provision.fog.smithi159:Waiting for deploy to finish 2023-08-30T22:48:51.025 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:48:51.085 INFO:teuthology.provision.fog.smithi094:Waiting for deploy to finish 2023-08-30T22:48:51.085 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:49:06.140 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:49:06.176 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:49:21.238 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:49:21.255 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:49:36.390 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:49:36.391 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:49:51.518 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:49:51.519 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:50:06.630 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:50:06.631 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:50:21.758 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:50:21.759 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:50:36.882 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:50:36.883 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:50:52.022 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:50:52.023 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:51:07.170 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:51:07.173 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:51:22.298 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:51:22.299 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:51:37.432 DEBUG:teuthology.provision.fog.smithi159:FOG request: GET /task/active None 2023-08-30T22:51:37.434 DEBUG:teuthology.provision.fog.smithi094:FOG request: GET /task/active None 2023-08-30T22:51:37.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:37.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:40.634 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:51:40.635 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:51:46.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:46.640 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:49.697 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:51:49.698 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:51:55.702 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:55.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:51:58.778 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:51:58.778 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:52:04.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:04.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:07.834 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:52:07.834 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:52:13.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:13.840 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:16.894 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:52:16.922 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:52:22.900 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:22.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:25.978 WARNING:teuthology.provision.fog.smithi094:[Errno None] Unable to connect to port 22 on 172.21.15.94 2023-08-30T22:52:25.978 WARNING:teuthology.provision.fog.smithi159:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-08-30T22:52:31.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:52:31.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:32.045 WARNING:teuthology.provision.fog.smithi094:timed out 2023-08-30T22:53:32.046 WARNING:teuthology.provision.fog.smithi159:timed out 2023-08-30T22:53:38.050 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:38.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:38.280 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:53:38.282 DEBUG:teuthology.orchestra.run.smithi094:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:53:38.378 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-30T22:53:38.378 DEBUG:teuthology.orchestra.run.smithi159:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-30T22:53:38.544 INFO:teuthology.provision.fog.smithi094:Node is ready 2023-08-30T22:53:38.545 DEBUG:teuthology.orchestra.run.smithi094:> hostname 2023-08-30T22:53:38.564 INFO:teuthology.orchestra.run.smithi094.stdout:smithi094.front.sepia.ceph.com 2023-08-30T22:53:38.564 DEBUG:teuthology.orchestra.run.smithi094:> grep smithi094.front.sepia.ceph.com /etc/hosts 2023-08-30T22:53:38.623 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.15.94 smithi094.front.sepia.ceph.com smithi094 2023-08-30T22:53:38.624 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-08-30T22:53:38.635 INFO:teuthology.provision.fog.smithi159:Node is ready 2023-08-30T22:53:38.635 DEBUG:teuthology.orchestra.run.smithi159:> hostname 2023-08-30T22:53:38.655 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159.front.sepia.ceph.com 2023-08-30T22:53:38.656 DEBUG:teuthology.orchestra.run.smithi159:> grep smithi159.front.sepia.ceph.com /etc/hosts 2023-08-30T22:53:38.715 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159 smithi159.front.sepia.ceph.com smithi159 2023-08-30T22:53:38.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-30T22:53:38.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hosts 2023-08-30T22:53:38.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/172.21.15.94/172.21.15.94/g' /etc/hosts 2023-08-30T22:53:38.804 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hosts 2023-08-30T22:53:38.821 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i -e 's/smithi094.front.sepia.ceph.com/smithi094/g' /etc/hostname 2023-08-30T22:53:38.834 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/172.21.15.159/172.21.15.159/g' /etc/hosts 2023-08-30T22:53:38.889 DEBUG:teuthology.orchestra.run.smithi094:> sudo hostname smithi094 2023-08-30T22:53:38.903 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i -e 's/smithi159.front.sepia.ceph.com/smithi159/g' /etc/hostname 2023-08-30T22:53:38.956 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-08-30T22:53:38.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname smithi159 2023-08-30T22:53:39.015 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-08-30T22:53:39.015 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:39.016 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:39.017 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:39.017 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:39.017 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:39.017 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:39.017 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:39.018 INFO:teuthology.provision.fog.smithi094:Deploy complete! 2023-08-30T22:53:39.019 DEBUG:teuthology.parallel:result is None 2023-08-30T22:53:39.038 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-30T22:53:39.096 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-08-30T22:53:39.097 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-08-30T22:53:39.097 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-08-30T22:53:39.097 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:39.097 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-08-30T22:53:39.097 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:39.098 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:39.098 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:39.098 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:39.098 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:39.098 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:39.099 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:39.099 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:39.099 INFO:teuthology.provision.fog.smithi159:Deploy complete! 2023-08-30T22:53:39.100 DEBUG:teuthology.parallel:result is None 2023-08-30T22:53:39.249 INFO:teuthology.lock.ops:Checking smithi094.front.sepia.ceph.com 2023-08-30T22:53:39.250 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:53:39.270 INFO:teuthology.lock.ops:Checking smithi159.front.sepia.ceph.com 2023-08-30T22:53:39.271 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-30T22:53:39.287 INFO:teuthology.lock.ops:Updating [smithi094.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:53:39.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-08-30T22:53:39.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:39.356 DEBUG:teuthology.orchestra.run.smithi094:> true 2023-08-30T22:53:39.379 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2023-08-30T22:53:39.380 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2023-08-30T22:53:39.437 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2023-08-30T22:53:39.438 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2023-08-30T22:53:39.496 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2023-08-30T22:53:39.496 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="8" 2023-08-30T22:53:39.497 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2023-08-30T22:53:39.497 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:39.497 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="8" 2023-08-30T22:53:39.497 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:39.497 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:39.498 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:39.498 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:39.498 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:39.498 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:39.498 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:39.499 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:39.499 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2023-08-30T22:53:39.521 INFO:teuthology.lock.ops:Updating [smithi159.front.sepia.ceph.com]: set os type and version on server 2023-08-30T22:53:39.521 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-30T22:53:39.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-30T22:53:39.588 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-08-30T22:53:39.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-08-30T22:53:39.657 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-08-30T22:53:39.714 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-08-30T22:53:39.715 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-08-30T22:53:39.772 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2023-08-30T22:53:39.773 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="8" 2023-08-30T22:53:39.773 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2023-08-30T22:53:39.773 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2023-08-30T22:53:39.773 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="8" 2023-08-30T22:53:39.773 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el8" 2023-08-30T22:53:39.774 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-30T22:53:39.774 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2023-08-30T22:53:39.774 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-30T22:53:39.774 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2023-08-30T22:53:39.775 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-30T22:53:39.775 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-30T22:53:39.775 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-30T22:53:39.775 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-08-30T22:53:39.803 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:53:39.894 INFO:teuthology.dispatcher.supervisor:Running job 7384814 2023-08-30T22:53:39.894 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384814 --name pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_8 clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/nautilus 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} -- /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384814/orig.config.yaml 2023-08-30T22:53:39.898 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384814 2023-08-30T22:53:39.899 INFO:teuthology.dispatcher.supervisor:Job PID: 3118823 2023-08-30T22:53:39.899 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-30T22:55:39.999 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:57:40.176 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T22:59:40.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:01:40.511 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:03:40.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:05:40.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:07:41.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-30T23:07:41.094 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-30T23:07:41.223 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-30T23:07:41.223 INFO:teuthology.nuke:Checking targets against current locks 2023-08-30T23:07:41.275 DEBUG:teuthology.nuke:shortname: smithi094 2023-08-30T23:07:41.276 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:07:41.297 DEBUG:teuthology.nuke:shortname: smithi159 2023-08-30T23:07:41.297 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-30T23:07:41.300 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384814', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:48:40.794064', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7XBKlUqAMx9nGpwDgjvnqmE8JNmCxjXf6h9gX+BfZfSqQNRBLntVPYRHvyMLxfITQlwLFwz/OIdXRfwwxRkB0naq22IzcBfy24yrKpoP4NZPsHsQBb90jJQiEluTWoWUO3l6/pJ0Dkm9Ne6QmBt65nNMUO/n2uf1jgNHQcNGHbRIdMDFa5/2FEeuBYEskXnVWza2v7sHZoE0jh6mI2No0MrXdQvwfZCRXhlQI+tOFrvXGplgSBy62yZdvkmWfmjdcXwg10p0ELbZPZObHNaGzKJHYwIrErbfc+48gtk0XrSGRvRK+u2TykCO6v1KaEIBZzRtk9rG178grL+EipaG9GorEjRUDhuO93mn05zArgL0DOU+sy877iGxCBMX4N0n+i3dfqlQkmTTuZ65BaJ5nYGqnOcYebksMW00BJawAcmnHXYj1uric6cQdQyk7F/repeWKk7LCAqaNY86iopq2t58s3zdKKgUej8i2ZX6+AgjUvsy1YJRPj8DHLW8+Xuc='} 2023-08-30T23:07:41.319 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-30_22:19:08-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7384814', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-30 22:48:40.792843', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3URoz5fVw/qiWvX7qC/na36oDMNVdCqgSgF2EEldk+9kk8n7jmKTR49zBv7khZo2YLrd9x51fCYECJAw9JbzutEkro58mYFEzyufccag/uoo9iBZrFIY4f3+i7X56p1t5vR+4IYb5KS1qsBpIK84tWARmzVUvluOtxlLrqv4+LXP+aF3wGm/+m/DL5nzvUkgo5IaiHU+5v4shTeXpgrol0komECRr4cfrPDryztJxE1ZDyUwyTj1D6k2WUs/xg0YckSJpGg8DfRZJpNWTyzwnAnb3HI1XP5B4cuCQ7RGIKDbGmc5+8TGQVqe2B6uUdBiR6YmnLNyuNosMFHzENFOoaaQjq8fMuOcPXlhO7vknppUBLisRETu3jocdlu2Q6quKPGvhu+Z0AHgWG/m3TiXX7Vvxl/JwiNuD64twBp9Dx9YfyK5YOn/WS1Z1Vq7eC9VukFUm32E869RLW5oYeZSDWN/4YAf6Hw0/N3bMbxjPcfO3r05AuDsYq8wTeSBS4x0='} 2023-08-30T23:07:41.351 INFO:teuthology.orchestra.console.smithi094:Power off 2023-08-30T23:07:41.351 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:07:41.364 INFO:teuthology.orchestra.console.smithi159:Power off 2023-08-30T23:07:41.364 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-30T23:07:41.371 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2023-08-30T23:07:41.372 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:07:41.384 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2023-08-30T23:07:41.385 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-30T23:07:41.392 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2023-08-30T23:07:41.406 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2023-08-30T23:07:41.493 INFO:teuthology.orchestra.console.smithi094:Power off completed 2023-08-30T23:07:41.507 INFO:teuthology.orchestra.console.smithi159:Power off completed 2023-08-30T23:07:41.642 INFO:teuthology.lock.ops:unlocked: smithi094.front.sepia.ceph.com 2023-08-30T23:07:41.650 INFO:teuthology.lock.ops:unlocked: smithi159.front.sepia.ceph.com