2023-09-28T02:52:45.924 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-28T02:52:45.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T02:52:46.071 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5066557670>, signals=[15]) 2023-09-28T02:52:46.072 INFO:teuthology.lock.ops:Start node 'smithi135.front.sepia.ceph.com' reimaging 2023-09-28T02:52:46.072 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T02:52:46.073 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-28T02:52:46.094 INFO:teuthology.lock.ops:Start node 'smithi144.front.sepia.ceph.com' reimaging 2023-09-28T02:52:46.095 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: reset os type and version on server 2023-09-28T02:52:46.095 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-28T02:52:46.096 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /host {"name": "smithi135"} 2023-09-28T02:52:46.119 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /host {"name": "smithi144"} 2023-09-28T02:52:46.169 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-28T02:52:46.189 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-28T02:52:46.213 DEBUG:teuthology.provision.fog.smithi135:Requesting image smithi_centos_8.stream (ID 3) 2023-09-28T02:52:46.213 DEBUG:teuthology.provision.fog.smithi135:FOG request: PUT /host/240 {"imageID": 3} 2023-09-28T02:52:46.231 DEBUG:teuthology.provision.fog.smithi144:Requesting image smithi_centos_8.stream (ID 3) 2023-09-28T02:52:46.231 DEBUG:teuthology.provision.fog.smithi144:FOG request: PUT /host/249 {"imageID": 3} 2023-09-28T02:52:46.257 INFO:teuthology.provision.fog.smithi135:Scheduling deploy of centos 8.stream 2023-09-28T02:52:46.257 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:52:46.271 INFO:teuthology.provision.fog.smithi144:Scheduling deploy of centos 8.stream 2023-09-28T02:52:46.271 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:52:46.301 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T02:52:46.312 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /tasktype {"name": "deploy"} 2023-09-28T02:52:46.340 DEBUG:teuthology.provision.fog.smithi135:FOG request: POST /host/240/task {"taskTypeID": 1} 2023-09-28T02:52:46.346 DEBUG:teuthology.provision.fog.smithi144:FOG request: POST /host/249/task {"taskTypeID": 1} 2023-09-28T02:52:46.408 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:52:46.411 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:52:46.500 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-28T02:52:46.500 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T02:52:46.514 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-28T02:52:46.514 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T02:52:46.523 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-28T02:52:46.523 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:46.535 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-28T02:52:46.536 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:46.546 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-28T02:52:46.558 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-28T02:52:46.648 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-28T02:52:46.659 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-28T02:52:46.749 INFO:teuthology.orchestra.console.smithi135:Power on 2023-09-28T02:52:46.749 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T02:52:46.760 INFO:teuthology.orchestra.console.smithi144:Power on 2023-09-28T02:52:46.760 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-28T02:52:46.770 DEBUG:teuthology.orchestra.console.smithi135:power on output: Chassis Power Control: Up/On 2023-09-28T02:52:46.771 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:46.781 DEBUG:teuthology.orchestra.console.smithi144:power on output: Chassis Power Control: Up/On 2023-09-28T02:52:46.781 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:46.791 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-28T02:52:46.803 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-28T02:52:50.794 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:50.803 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:50.902 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-28T02:52:50.912 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is on 2023-09-28T02:52:51.013 INFO:teuthology.orchestra.console.smithi144:Power on completed 2023-09-28T02:52:51.113 INFO:teuthology.provision.fog.smithi144:Waiting for deploy to finish 2023-09-28T02:52:51.114 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:52:54.906 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T02:52:55.134 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is on 2023-09-28T02:52:55.235 INFO:teuthology.orchestra.console.smithi135:Power on completed 2023-09-28T02:52:55.336 INFO:teuthology.provision.fog.smithi135:Waiting for deploy to finish 2023-09-28T02:52:55.336 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:53:06.182 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:53:10.397 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:53:21.254 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:53:25.462 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:53:36.326 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:53:40.530 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:53:51.414 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:53:55.605 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:54:06.490 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:54:10.678 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:54:21.566 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:54:25.745 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:54:36.642 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:54:40.810 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:54:51.718 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:54:55.874 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:55:06.790 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:55:10.946 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:55:21.874 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:55:26.006 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:55:36.942 DEBUG:teuthology.provision.fog.smithi144:FOG request: GET /task/active None 2023-09-28T02:55:37.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:55:41.066 DEBUG:teuthology.provision.fog.smithi135:FOG request: GET /task/active None 2023-09-28T02:55:41.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:55:55.514 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-28T02:55:59.610 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-28T02:56:01.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:04.574 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-28T02:56:05.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:08.670 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-28T02:56:10.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:13.658 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-28T02:56:14.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:17.754 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-28T02:56:19.662 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:22.721 WARNING:teuthology.provision.fog.smithi144:[Errno None] Unable to connect to port 22 on 172.21.15.144 2023-09-28T02:56:23.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:26.810 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-28T02:56:28.722 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:32.815 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:56:35.870 WARNING:teuthology.provision.fog.smithi135:[Errno None] Unable to connect to port 22 on 172.21.15.135 2023-09-28T02:56:41.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:57:28.770 WARNING:teuthology.provision.fog.smithi144:timed out 2023-09-28T02:57:34.775 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:57:35.000 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T02:57:35.000 DEBUG:teuthology.orchestra.run.smithi144:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T02:57:35.259 INFO:teuthology.provision.fog.smithi144:Node is ready 2023-09-28T02:57:35.259 DEBUG:teuthology.orchestra.run.smithi144:> hostname 2023-09-28T02:57:35.278 INFO:teuthology.orchestra.run.smithi144.stdout:smithi144.front.sepia.ceph.com 2023-09-28T02:57:35.278 DEBUG:teuthology.orchestra.run.smithi144:> grep smithi144.front.sepia.ceph.com /etc/hosts 2023-09-28T02:57:35.337 INFO:teuthology.orchestra.run.smithi144.stdout:172.21.15.144 smithi144.front.sepia.ceph.com smithi144 2023-09-28T02:57:35.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-28T02:57:35.458 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hosts 2023-09-28T02:57:35.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/172.21.15.144/172.21.15.144/g' /etc/hosts 2023-09-28T02:57:35.553 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i -e 's/smithi144.front.sepia.ceph.com/smithi144/g' /etc/hostname 2023-09-28T02:57:35.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname smithi144 2023-09-28T02:57:35.686 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-28T02:57:35.744 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T02:57:35.745 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T02:57:35.745 INFO:teuthology.provision.fog.smithi144:Deploy complete! 2023-09-28T02:57:35.747 DEBUG:teuthology.parallel:result is None 2023-09-28T02:57:41.883 WARNING:teuthology.provision.fog.smithi135:timed out 2023-09-28T02:57:47.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:57:48.153 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-28T02:57:48.153 DEBUG:teuthology.orchestra.run.smithi135:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-28T02:57:48.398 INFO:teuthology.provision.fog.smithi135:Node is ready 2023-09-28T02:57:48.398 DEBUG:teuthology.orchestra.run.smithi135:> hostname 2023-09-28T02:57:48.416 INFO:teuthology.orchestra.run.smithi135.stdout:smithi135.front.sepia.ceph.com 2023-09-28T02:57:48.417 DEBUG:teuthology.orchestra.run.smithi135:> grep smithi135.front.sepia.ceph.com /etc/hosts 2023-09-28T02:57:48.475 INFO:teuthology.orchestra.run.smithi135.stdout:172.21.15.135 smithi135.front.sepia.ceph.com smithi135 2023-09-28T02:57:48.476 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-09-28T02:57:48.580 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hosts 2023-09-28T02:57:48.609 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/172.21.15.135/172.21.15.135/g' /etc/hosts 2023-09-28T02:57:48.678 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i -e 's/smithi135.front.sepia.ceph.com/smithi135/g' /etc/hostname 2023-09-28T02:57:48.746 DEBUG:teuthology.orchestra.run.smithi135:> sudo hostname smithi135 2023-09-28T02:57:48.812 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T02:57:48.870 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-09-28T02:57:48.871 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T02:57:48.871 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T02:57:48.871 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T02:57:48.871 INFO:teuthology.provision.fog.smithi135:Deploy complete! 2023-09-28T02:57:48.871 DEBUG:teuthology.parallel:result is None 2023-09-28T02:57:49.013 INFO:teuthology.lock.ops:Checking smithi135.front.sepia.ceph.com 2023-09-28T02:57:49.014 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T02:57:49.037 INFO:teuthology.lock.ops:Checking smithi144.front.sepia.ceph.com 2023-09-28T02:57:49.038 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-28T02:57:49.055 INFO:teuthology.lock.ops:Updating [smithi135.front.sepia.ceph.com]: set os type and version on server 2023-09-28T02:57:49.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-28T02:57:49.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:57:49.122 DEBUG:teuthology.orchestra.run.smithi135:> true 2023-09-28T02:57:49.192 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2023-09-28T02:57:49.192 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2023-09-28T02:57:49.249 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2023-09-28T02:57:49.250 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="8" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="8" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el8" 2023-09-28T02:57:49.307 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T02:57:49.308 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T02:57:49.308 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2023-09-28T02:57:49.329 INFO:teuthology.lock.ops:Updating [smithi144.front.sepia.ceph.com]: set os type and version on server 2023-09-28T02:57:49.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-28T02:57:49.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-28T02:57:49.397 DEBUG:teuthology.orchestra.run.smithi144:> true 2023-09-28T02:57:49.534 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2023-09-28T02:57:49.534 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2023-09-28T02:57:49.594 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2023-09-28T02:57:49.594 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2023-09-28T02:57:49.654 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="8" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="8" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el8" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-28T02:57:49.655 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2023-09-28T02:57:49.656 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-28T02:57:49.656 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-28T02:57:49.656 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-28T02:57:49.656 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2023-09-28T02:57:49.679 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T02:57:49.775 INFO:teuthology.dispatcher.supervisor:Running job 7403575 2023-09-28T02:57:49.775 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403575 --name yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore/bluestore-bitmap overrides/{frag ignorelist_health ignorelist_wrongly_marked_down multifs session_timeout thrashosds-health} tasks/{1-thrash/mon 2-workunit/cfuse_workunit_trivial_sync}} -- /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403575/orig.config.yaml 2023-09-28T02:57:49.778 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403575 2023-09-28T02:57:49.778 INFO:teuthology.dispatcher.supervisor:Job PID: 923283 2023-09-28T02:57:49.778 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-28T02:59:49.800 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:01:49.976 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:03:50.143 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:05:50.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:07:50.399 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:09:50.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:11:50.638 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:13:50.811 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:15:50.983 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:17:51.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:19:51.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:21:51.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-28T03:21:51.560 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-28T03:21:51.670 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-28T03:21:51.670 INFO:teuthology.nuke:Checking targets against current locks 2023-09-28T03:21:51.719 DEBUG:teuthology.nuke:shortname: smithi135 2023-09-28T03:21:51.720 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T03:21:51.734 DEBUG:teuthology.nuke:shortname: smithi144 2023-09-28T03:21:51.734 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-28T03:21:51.739 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 02:52:45.111406', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEWbCVXj8baQ4DnZp84RQ/3fD0FuKaDmWQw8JR4JROQ0L15th7IQg05g9wZIjl7I7FTHfEC3urMxc2ZMyKm/2m8='} 2023-09-28T03:21:51.750 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-27_19:23:53-fs-wip-yuri-testing-2023-09-27-0906-quincy-distro-default-smithi/7403575', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-28 02:52:45.109663', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGZ2uuvhqDyBzrNP2RDZC1U5kX8zifcjuEJ7NkOo94lKrY1yXPb6nP0hkToW1CGa+cNizSpSN+wyHQhpPSL1l3Y='} 2023-09-28T03:21:51.779 INFO:teuthology.orchestra.console.smithi135:Power off 2023-09-28T03:21:51.779 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T03:21:51.791 INFO:teuthology.orchestra.console.smithi144:Power off 2023-09-28T03:21:51.791 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-28T03:21:51.800 DEBUG:teuthology.orchestra.console.smithi135:power off output: Chassis Power Control: Down/Off 2023-09-28T03:21:51.800 DEBUG:teuthology.orchestra.console.smithi135:pexpect command: ipmitool -H smithi135.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T03:21:51.810 DEBUG:teuthology.orchestra.console.smithi144:power off output: Chassis Power Control: Down/Off 2023-09-28T03:21:51.811 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: ipmitool -H smithi144.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-28T03:21:51.820 DEBUG:teuthology.orchestra.console.smithi135:check power output: Chassis Power is off 2023-09-28T03:21:51.830 DEBUG:teuthology.orchestra.console.smithi144:check power output: Chassis Power is off 2023-09-28T03:21:51.921 INFO:teuthology.orchestra.console.smithi135:Power off completed 2023-09-28T03:21:51.931 INFO:teuthology.orchestra.console.smithi144:Power off completed 2023-09-28T03:21:52.067 INFO:teuthology.lock.ops:unlocked: smithi135.front.sepia.ceph.com 2023-09-28T03:21:52.075 INFO:teuthology.lock.ops:unlocked: smithi144.front.sepia.ceph.com