2023-08-31T04:26:16.712 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T04:26:16.713 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T04:26:16.858 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6e81b71ee0>, signals=[15]) 2023-08-31T04:26:16.859 INFO:teuthology.lock.ops:Start node 'smithi096.front.sepia.ceph.com' reimaging 2023-08-31T04:26:16.861 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T04:26:16.862 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-08-31T04:26:16.880 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-08-31T04:26:16.880 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-08-31T04:26:16.881 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-08-31T04:26:16.882 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /host {"name": "smithi096"} 2023-08-31T04:26:16.905 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /host {"name": "smithi101"} 2023-08-31T04:26:16.956 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T04:26:16.980 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-31T04:26:16.995 DEBUG:teuthology.provision.fog.smithi096:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T04:26:16.996 DEBUG:teuthology.provision.fog.smithi096:FOG request: PUT /host/201 {"imageID": 10} 2023-08-31T04:26:17.023 DEBUG:teuthology.provision.fog.smithi101:Requesting image smithi_centos_9.stream (ID 10) 2023-08-31T04:26:17.023 DEBUG:teuthology.provision.fog.smithi101:FOG request: PUT /host/206 {"imageID": 10} 2023-08-31T04:26:17.038 INFO:teuthology.provision.fog.smithi096:Scheduling deploy of centos 9.stream 2023-08-31T04:26:17.039 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:26:17.074 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of centos 9.stream 2023-08-31T04:26:17.074 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:26:17.089 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T04:26:17.117 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /tasktype {"name": "deploy"} 2023-08-31T04:26:17.124 DEBUG:teuthology.provision.fog.smithi096:FOG request: POST /host/201/task {"taskTypeID": 1} 2023-08-31T04:26:17.165 DEBUG:teuthology.provision.fog.smithi101:FOG request: POST /host/206/task {"taskTypeID": 1} 2023-08-31T04:26:17.195 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:26:17.231 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:26:17.286 INFO:teuthology.orchestra.console.smithi096:Power off 2023-08-31T04:26:17.287 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T04:26:17.308 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-08-31T04:26:17.308 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:17.323 INFO:teuthology.orchestra.console.smithi101:Power off 2023-08-31T04:26:17.324 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T04:26:17.333 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-31T04:26:17.343 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-08-31T04:26:17.344 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:17.365 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-31T04:26:17.434 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-08-31T04:26:17.497 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-08-31T04:26:17.598 INFO:teuthology.orchestra.console.smithi096:Power on 2023-08-31T04:26:17.599 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T04:26:17.606 INFO:teuthology.orchestra.console.smithi101:Power on 2023-08-31T04:26:17.607 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-31T04:26:17.621 DEBUG:teuthology.orchestra.console.smithi096:power on output: Chassis Power Control: Up/On 2023-08-31T04:26:17.621 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:17.630 DEBUG:teuthology.orchestra.console.smithi101:power on output: Chassis Power Control: Up/On 2023-08-31T04:26:17.630 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:17.641 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-31T04:26:17.650 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-31T04:26:21.645 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:21.652 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:21.755 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-31T04:26:21.761 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-31T04:26:25.758 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:25.764 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:26:25.874 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is on 2023-08-31T04:26:25.929 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-31T04:26:25.975 INFO:teuthology.orchestra.console.smithi101:Power on completed 2023-08-31T04:26:26.030 INFO:teuthology.orchestra.console.smithi096:Power on completed 2023-08-31T04:26:26.077 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-08-31T04:26:26.077 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:26:26.131 INFO:teuthology.provision.fog.smithi096:Waiting for deploy to finish 2023-08-31T04:26:26.132 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:26:41.166 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:26:41.198 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:26:56.246 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:26:56.265 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:27:11.330 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:27:11.335 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:27:26.414 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:27:26.415 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:27:41.498 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:27:41.500 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:27:56.582 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:27:56.583 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:28:11.674 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:28:11.675 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:28:26.778 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:28:26.780 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:28:41.874 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:28:41.875 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:28:56.986 DEBUG:teuthology.provision.fog.smithi096:FOG request: GET /task/active None 2023-08-31T04:28:56.990 DEBUG:teuthology.provision.fog.smithi101:FOG request: GET /task/active None 2023-08-31T04:28:57.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:28:57.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:00.122 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:00.123 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:06.126 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:06.128 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:09.178 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:09.210 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:15.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:15.211 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:18.234 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:18.270 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:24.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:24.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:27.322 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:27.326 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:33.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:33.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:36.378 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:36.378 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:42.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:42.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:45.442 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:29:45.466 WARNING:teuthology.provision.fog.smithi101:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-08-31T04:29:51.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:51.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:29:54.526 WARNING:teuthology.provision.fog.smithi096:[Errno None] Unable to connect to port 22 on 172.21.15.96 2023-08-31T04:30:00.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:30:51.518 WARNING:teuthology.provision.fog.smithi101:timed out 2023-08-31T04:30:57.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:30:57.746 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T04:30:57.747 DEBUG:teuthology.orchestra.run.smithi101:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T04:30:58.074 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-08-31T04:30:58.075 DEBUG:teuthology.orchestra.run.smithi101:> hostname 2023-08-31T04:30:58.090 INFO:teuthology.orchestra.run.smithi101.stdout:smithi101.front.sepia.ceph.com 2023-08-31T04:30:58.091 DEBUG:teuthology.orchestra.run.smithi101:> grep smithi101.front.sepia.ceph.com /etc/hosts 2023-08-31T04:30:58.147 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.101 smithi101.front.sepia.ceph.com smithi101 2023-08-31T04:30:58.147 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-08-31T04:30:58.275 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hosts 2023-08-31T04:30:58.305 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/172.21.15.101/172.21.15.101/g' /etc/hosts 2023-08-31T04:30:58.374 DEBUG:teuthology.orchestra.run.smithi101:> sudo sed -i -e 's/smithi101.front.sepia.ceph.com/smithi101/g' /etc/hostname 2023-08-31T04:30:58.443 DEBUG:teuthology.orchestra.run.smithi101:> sudo hostname smithi101 2023-08-31T04:30:58.511 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-08-31T04:30:58.566 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-08-31T04:30:58.566 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="9" 2023-08-31T04:30:58.567 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-08-31T04:30:58.567 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-08-31T04:30:58.567 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="9" 2023-08-31T04:30:58.567 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el9" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:LOGO="fedora-logo-icon" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-08-31T04:30:58.568 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T04:30:58.569 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T04:30:58.569 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T04:30:58.570 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-08-31T04:30:58.571 DEBUG:teuthology.parallel:result is None 2023-08-31T04:31:00.536 WARNING:teuthology.provision.fog.smithi096:timed out 2023-08-31T04:31:06.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:31:06.777 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-31T04:31:06.778 DEBUG:teuthology.orchestra.run.smithi096:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-31T04:31:07.096 INFO:teuthology.provision.fog.smithi096:Node is ready 2023-08-31T04:31:07.096 DEBUG:teuthology.orchestra.run.smithi096:> hostname 2023-08-31T04:31:07.112 INFO:teuthology.orchestra.run.smithi096.stdout:smithi096.front.sepia.ceph.com 2023-08-31T04:31:07.112 DEBUG:teuthology.orchestra.run.smithi096:> grep smithi096.front.sepia.ceph.com /etc/hosts 2023-08-31T04:31:07.167 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.15.96 smithi096.front.sepia.ceph.com smithi096 2023-08-31T04:31:07.167 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-08-31T04:31:07.286 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hosts 2023-08-31T04:31:07.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/172.21.15.96/172.21.15.96/g' /etc/hosts 2023-08-31T04:31:07.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i -e 's/smithi096.front.sepia.ceph.com/smithi096/g' /etc/hostname 2023-08-31T04:31:07.453 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname smithi096 2023-08-31T04:31:07.519 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-08-31T04:31:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-08-31T04:31:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-08-31T04:31:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-08-31T04:31:07.575 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-08-31T04:31:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-08-31T04:31:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-08-31T04:31:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T04:31:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-08-31T04:31:07.576 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-08-31T04:31:07.577 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T04:31:07.577 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-08-31T04:31:07.577 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T04:31:07.577 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T04:31:07.577 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T04:31:07.578 INFO:teuthology.provision.fog.smithi096:Deploy complete! 2023-08-31T04:31:07.578 DEBUG:teuthology.parallel:result is None 2023-08-31T04:31:07.742 INFO:teuthology.lock.ops:Checking smithi096.front.sepia.ceph.com 2023-08-31T04:31:07.743 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T04:31:07.761 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-08-31T04:31:07.762 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-31T04:31:07.779 INFO:teuthology.lock.ops:Updating [smithi096.front.sepia.ceph.com]: set os type and version on server 2023-08-31T04:31:07.780 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-31T04:31:07.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:31:07.862 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-08-31T04:31:07.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-31T04:31:07.932 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-08-31T04:31:07.986 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-08-31T04:31:07.987 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-08-31T04:31:08.041 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="CentOS Stream" 2023-08-31T04:31:08.042 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="9" 2023-08-31T04:31:08.042 INFO:teuthology.orchestra.run.smithi096.stdout:ID="centos" 2023-08-31T04:31:08.042 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="rhel fedora" 2023-08-31T04:31:08.042 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="9" 2023-08-31T04:31:08.042 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el9" 2023-08-31T04:31:08.043 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T04:31:08.043 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-08-31T04:31:08.043 INFO:teuthology.orchestra.run.smithi096.stdout:LOGO="fedora-logo-icon" 2023-08-31T04:31:08.043 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T04:31:08.043 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://centos.org/" 2023-08-31T04:31:08.044 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T04:31:08.044 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T04:31:08.044 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T04:31:08.045 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-08-31T04:31:08.070 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-08-31T04:31:08.070 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-31T04:31:08.071 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi101.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T04:31:08.157 DEBUG:teuthology.orchestra.run.smithi101:> true 2023-08-31T04:31:08.226 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-08-31T04:31:08.226 DEBUG:teuthology.orchestra.run.smithi101:> uname -m 2023-08-31T04:31:08.283 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-08-31T04:31:08.283 DEBUG:teuthology.orchestra.run.smithi101:> cat /etc/os-release 2023-08-31T04:31:08.338 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="CentOS Stream" 2023-08-31T04:31:08.339 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="9" 2023-08-31T04:31:08.339 INFO:teuthology.orchestra.run.smithi101.stdout:ID="centos" 2023-08-31T04:31:08.339 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="rhel fedora" 2023-08-31T04:31:08.340 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="9" 2023-08-31T04:31:08.340 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el9" 2023-08-31T04:31:08.340 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-31T04:31:08.341 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-08-31T04:31:08.341 INFO:teuthology.orchestra.run.smithi101.stdout:LOGO="fedora-logo-icon" 2023-08-31T04:31:08.341 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-31T04:31:08.341 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://centos.org/" 2023-08-31T04:31:08.342 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T04:31:08.342 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-31T04:31:08.343 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-31T04:31:08.343 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-08-31T04:31:08.370 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T04:31:08.477 INFO:teuthology.dispatcher.supervisor:Running job 7385226 2023-08-31T04:31:08.478 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385226 --name vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/mon 2-workunit/fs/snaps}} -- /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385226/orig.config.yaml 2023-08-31T04:31:08.480 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385226 2023-08-31T04:31:08.481 INFO:teuthology.dispatcher.supervisor:Job PID: 2280799 2023-08-31T04:31:08.481 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-31T04:33:08.582 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T04:33:08.657 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-31T04:33:08.786 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-31T04:33:08.786 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T04:33:08.839 DEBUG:teuthology.nuke:shortname: smithi096 2023-08-31T04:33:08.839 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T04:33:08.867 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 04:26:15.883877', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN2vuLZRMz28B6mDjpH32DxqOGKcDYAfz/n76eS+K1Ep6WT+pTj3P/fKkGwgV3TPKp5IIChksphPQ2ZpNOsnQ68='} 2023-08-31T04:33:08.873 DEBUG:teuthology.nuke:shortname: smithi101 2023-08-31T04:33:08.874 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T04:33:08.899 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi101.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-08-31_04:13:51-fs-wip-vshankar-testing-20230830.153114-testing-default-smithi/7385226', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 04:26:15.885602', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLKIEcCkWfpzbW6x+cUT9A1M+bHyUo2DfMHJQvbAcJXr4nZMpPDHtwHsNOwPYrV0EtjnnujaVD03th3nLPsxOFg='} 2023-08-31T04:33:08.927 INFO:teuthology.orchestra.console.smithi096:Power off 2023-08-31T04:33:08.928 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T04:33:08.949 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-08-31T04:33:08.950 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:33:08.966 INFO:teuthology.orchestra.console.smithi101:Power off 2023-08-31T04:33:08.967 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T04:33:08.978 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-31T04:33:08.991 DEBUG:teuthology.orchestra.console.smithi101:power off output: Chassis Power Control: Down/Off 2023-08-31T04:33:08.993 DEBUG:teuthology.orchestra.console.smithi101:pexpect command: ipmitool -H smithi101.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T04:33:09.019 DEBUG:teuthology.orchestra.console.smithi101:check power output: Chassis Power is off 2023-08-31T04:33:09.079 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-08-31T04:33:09.121 INFO:teuthology.orchestra.console.smithi101:Power off completed 2023-08-31T04:33:09.239 INFO:teuthology.lock.ops:unlocked: smithi096.front.sepia.ceph.com 2023-08-31T04:33:09.274 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com