2023-08-05T00:05:39.487 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-05T00:05:39.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:05:39.632 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc1551abee0>, signals=[15]) 2023-08-05T00:05:39.633 INFO:teuthology.lock.ops:Start node 'smithi026.front.sepia.ceph.com' reimaging 2023-08-05T00:05:39.634 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: reset os type and version on server 2023-08-05T00:05:39.634 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-08-05T00:05:39.655 INFO:teuthology.lock.ops:Start node 'smithi173.front.sepia.ceph.com' reimaging 2023-08-05T00:05:39.655 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: reset os type and version on server 2023-08-05T00:05:39.655 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-08-05T00:05:39.657 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /host {"name": "smithi026"} 2023-08-05T00:05:39.680 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /host {"name": "smithi173"} 2023-08-05T00:05:39.728 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-05T00:05:39.749 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-08-05T00:05:39.765 DEBUG:teuthology.provision.fog.smithi026:Requesting image smithi_centos_8.stream (ID 3) 2023-08-05T00:05:39.765 DEBUG:teuthology.provision.fog.smithi026:FOG request: PUT /host/131 {"imageID": 3} 2023-08-05T00:05:39.791 DEBUG:teuthology.provision.fog.smithi173:Requesting image smithi_centos_8.stream (ID 3) 2023-08-05T00:05:39.791 DEBUG:teuthology.provision.fog.smithi173:FOG request: PUT /host/278 {"imageID": 3} 2023-08-05T00:05:39.812 INFO:teuthology.provision.fog.smithi026:Scheduling deploy of centos 8.stream 2023-08-05T00:05:39.812 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:05:39.837 INFO:teuthology.provision.fog.smithi173:Scheduling deploy of centos 8.stream 2023-08-05T00:05:39.837 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:05:39.851 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /tasktype {"name": "deploy"} 2023-08-05T00:05:39.876 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /tasktype {"name": "deploy"} 2023-08-05T00:05:39.887 DEBUG:teuthology.provision.fog.smithi026:FOG request: POST /host/131/task {"taskTypeID": 1} 2023-08-05T00:05:39.910 DEBUG:teuthology.provision.fog.smithi173:FOG request: POST /host/278/task {"taskTypeID": 1} 2023-08-05T00:05:40.012 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:05:40.027 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:05:40.094 INFO:teuthology.orchestra.console.smithi173:Power off 2023-08-05T00:05:40.095 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-05T00:05:40.117 INFO:teuthology.orchestra.console.smithi026:Power off 2023-08-05T00:05:40.118 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-05T00:05:40.129 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-08-05T00:05:40.130 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:40.147 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-08-05T00:05:40.148 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:40.158 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-08-05T00:05:40.172 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-08-05T00:05:44.160 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:44.173 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:44.271 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-08-05T00:05:44.283 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-08-05T00:05:48.276 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:48.284 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:48.388 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-08-05T00:05:48.395 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-08-05T00:05:48.490 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-08-05T00:05:48.497 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-08-05T00:05:48.591 INFO:teuthology.orchestra.console.smithi173:Power on 2023-08-05T00:05:48.592 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-05T00:05:48.600 INFO:teuthology.orchestra.console.smithi026:Power on 2023-08-05T00:05:48.601 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-05T00:05:48.612 DEBUG:teuthology.orchestra.console.smithi173:power on output: Chassis Power Control: Up/On 2023-08-05T00:05:48.613 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:48.623 DEBUG:teuthology.orchestra.console.smithi026:power on output: Chassis Power Control: Up/On 2023-08-05T00:05:48.624 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:48.634 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-08-05T00:05:48.644 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-08-05T00:05:52.640 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:52.649 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:52.751 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-08-05T00:05:52.760 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-08-05T00:05:56.756 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:56.765 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:05:56.867 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-08-05T00:05:56.955 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-08-05T00:05:56.968 INFO:teuthology.orchestra.console.smithi173:Power on completed 2023-08-05T00:05:57.056 INFO:teuthology.orchestra.console.smithi026:Power on completed 2023-08-05T00:05:57.070 INFO:teuthology.provision.fog.smithi173:Waiting for deploy to finish 2023-08-05T00:05:57.070 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:05:57.157 INFO:teuthology.provision.fog.smithi026:Waiting for deploy to finish 2023-08-05T00:05:57.158 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:06:12.144 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:06:12.204 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:06:27.212 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:06:27.252 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:06:42.276 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:06:42.297 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:06:57.340 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:06:57.344 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:07:12.404 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:07:12.405 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:07:27.476 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:07:27.477 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:07:42.540 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:07:42.542 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:07:57.610 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:07:57.612 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:08:12.674 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:08:12.675 DEBUG:teuthology.provision.fog.smithi026:FOG request: GET /task/active None 2023-08-05T00:08:12.729 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:08:27.733 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:08:31.088 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-08-05T00:08:37.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:08:40.144 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-08-05T00:08:42.782 DEBUG:teuthology.provision.fog.smithi173:FOG request: GET /task/active None 2023-08-05T00:08:42.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:08:46.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:08:49.200 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-08-05T00:08:55.204 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:08:58.260 WARNING:teuthology.provision.fog.smithi026:[Errno None] Unable to connect to port 22 on 172.21.15.26 2023-08-05T00:09:01.296 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-08-05T00:09:04.264 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:09:07.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:09:10.352 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-08-05T00:09:16.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:09:19.408 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-08-05T00:09:25.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:09:28.464 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-08-05T00:09:34.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:09:37.556 WARNING:teuthology.provision.fog.smithi173:[Errno None] Unable to connect to port 22 on 172.21.15.173 2023-08-05T00:09:43.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:10:04.284 WARNING:teuthology.provision.fog.smithi026:timed out 2023-08-05T00:10:10.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:10:10.530 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-05T00:10:10.531 DEBUG:teuthology.orchestra.run.smithi026:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-05T00:10:10.791 INFO:teuthology.provision.fog.smithi026:Node is ready 2023-08-05T00:10:10.792 DEBUG:teuthology.orchestra.run.smithi026:> hostname 2023-08-05T00:10:10.812 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026.front.sepia.ceph.com 2023-08-05T00:10:10.813 DEBUG:teuthology.orchestra.run.smithi026:> grep smithi026.front.sepia.ceph.com /etc/hosts 2023-08-05T00:10:10.872 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26 smithi026.front.sepia.ceph.com smithi026 2023-08-05T00:10:10.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-08-05T00:10:10.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hosts 2023-08-05T00:10:11.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/172.21.15.26/172.21.15.26/g' /etc/hosts 2023-08-05T00:10:11.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i -e 's/smithi026.front.sepia.ceph.com/smithi026/g' /etc/hostname 2023-08-05T00:10:11.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname smithi026 2023-08-05T00:10:11.214 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-08-05T00:10:11.272 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-08-05T00:10:11.272 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-08-05T00:10:11.273 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-05T00:10:11.274 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-08-05T00:10:11.274 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-05T00:10:11.274 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-05T00:10:11.274 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-05T00:10:11.275 INFO:teuthology.provision.fog.smithi026:Deploy complete! 2023-08-05T00:10:11.276 DEBUG:teuthology.parallel:result is None 2023-08-05T00:10:43.596 WARNING:teuthology.provision.fog.smithi173:timed out 2023-08-05T00:10:49.603 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:10:49.835 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-05T00:10:49.836 DEBUG:teuthology.orchestra.run.smithi173:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-05T00:10:50.088 INFO:teuthology.provision.fog.smithi173:Node is ready 2023-08-05T00:10:50.088 DEBUG:teuthology.orchestra.run.smithi173:> hostname 2023-08-05T00:10:50.108 INFO:teuthology.orchestra.run.smithi173.stdout:smithi173.front.sepia.ceph.com 2023-08-05T00:10:50.108 DEBUG:teuthology.orchestra.run.smithi173:> grep smithi173.front.sepia.ceph.com /etc/hosts 2023-08-05T00:10:50.167 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.15.173 smithi173.front.sepia.ceph.com smithi173 2023-08-05T00:10:50.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-08-05T00:10:50.258 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hosts 2023-08-05T00:10:50.289 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/172.21.15.173/172.21.15.173/g' /etc/hosts 2023-08-05T00:10:50.358 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i -e 's/smithi173.front.sepia.ceph.com/smithi173/g' /etc/hostname 2023-08-05T00:10:50.426 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname smithi173 2023-08-05T00:10:50.493 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-08-05T00:10:50.551 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-08-05T00:10:50.551 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2023-08-05T00:10:50.551 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-05T00:10:50.552 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-08-05T00:10:50.553 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-05T00:10:50.553 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-05T00:10:50.553 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-05T00:10:50.553 INFO:teuthology.provision.fog.smithi173:Deploy complete! 2023-08-05T00:10:50.554 DEBUG:teuthology.parallel:result is None 2023-08-05T00:10:50.689 INFO:teuthology.lock.ops:Checking smithi026.front.sepia.ceph.com 2023-08-05T00:10:50.689 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-05T00:10:50.730 INFO:teuthology.lock.ops:Checking smithi173.front.sepia.ceph.com 2023-08-05T00:10:50.730 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-05T00:10:50.756 INFO:teuthology.lock.ops:Updating [smithi026.front.sepia.ceph.com]: set os type and version on server 2023-08-05T00:10:50.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-08-05T00:10:50.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:10:50.824 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-08-05T00:10:50.963 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-08-05T00:10:50.964 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-08-05T00:10:51.022 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-08-05T00:10:51.022 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="CentOS Stream" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:ID="centos" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="rhel fedora" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-08-05T00:10:51.081 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://centos.org/" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-05T00:10:51.082 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-05T00:10:51.083 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-08-05T00:10:51.105 INFO:teuthology.lock.ops:Updating [smithi173.front.sepia.ceph.com]: set os type and version on server 2023-08-05T00:10:51.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-08-05T00:10:51.105 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-05T00:10:51.171 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-08-05T00:10:51.238 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-08-05T00:10:51.238 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-08-05T00:10:51.297 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-08-05T00:10:51.298 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-08-05T00:10:51.355 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2023-08-05T00:10:51.355 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8" 2023-08-05T00:10:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2023-08-05T00:10:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2023-08-05T00:10:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8" 2023-08-05T00:10:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-08-05T00:10:51.356 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-05T00:10:51.357 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-05T00:10:51.358 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-08-05T00:10:51.380 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:10:51.472 INFO:teuthology.dispatcher.supervisor:Running job 7361295 2023-08-05T00:10:51.473 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi/7361295 --name yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi --description fs/thrash/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi/7361295/orig.config.yaml 2023-08-05T00:10:51.476 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi/7361295 2023-08-05T00:10:51.477 INFO:teuthology.dispatcher.supervisor:Job PID: 12195 2023-08-05T00:10:51.477 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-05T00:12:51.569 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:14:51.740 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:16:51.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:18:51.989 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:20:52.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:22:52.303 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:24:52.448 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:26:52.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:28:52.773 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:30:52.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:32:53.069 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:34:53.229 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:36:53.394 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:38:53.553 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:40:53.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-05T00:40:53.790 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-05T00:40:53.972 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-05T00:40:53.973 INFO:teuthology.nuke:Checking targets against current locks 2023-08-05T00:40:54.019 DEBUG:teuthology.nuke:shortname: smithi026 2023-08-05T00:40:54.020 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-05T00:40:54.045 DEBUG:teuthology.nuke:shortname: smithi173 2023-08-05T00:40:54.046 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-05T00:40:54.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi/7361295', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-05 00:05:38.665072', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ9/NaciPSW2bZ/JYBGb+3s9uoq97ZyNCikuYnOehIeqHIK3YV+ZcVNZIYTXfEPNJmgC4+/t5QWIHA1h3UOZ4IM='} 2023-08-05T00:40:54.068 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-04_19:01:13-fs-wip-yuri10-testing-2023-08-01-0753-pacific-distro-default-smithi/7361295', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-05 00:05:38.663244', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDBTnwd30iKkQHHdZLYpNJeKHmpAlYvVjOkaLGIKX2Hg2BKP4aOPOnxGueUaYJLl/plaQDJVVFsOpI3bG9sr6/g='} 2023-08-05T00:40:54.100 INFO:teuthology.orchestra.console.smithi026:Power off 2023-08-05T00:40:54.101 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-05T00:40:54.120 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-08-05T00:40:54.121 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:40:54.137 INFO:teuthology.orchestra.console.smithi173:Power off 2023-08-05T00:40:54.138 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-05T00:40:54.146 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-08-05T00:40:54.158 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-08-05T00:40:54.158 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-05T00:40:54.180 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-08-05T00:40:54.248 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-08-05T00:40:54.282 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-08-05T00:40:54.406 INFO:teuthology.lock.ops:unlocked: smithi026.front.sepia.ceph.com 2023-08-05T00:40:54.422 INFO:teuthology.lock.ops:unlocked: smithi173.front.sepia.ceph.com