2023-08-07T20:40:30.277 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-07T20:40:30.278 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:40:30.424 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc32b434ee0>, signals=[15]) 2023-08-07T20:40:30.425 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2023-08-07T20:40:30.426 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T20:40:30.426 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-08-07T20:40:30.451 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2023-08-07T20:40:30.451 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2023-08-07T20:40:30.452 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-07T20:40:30.454 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"} 2023-08-07T20:40:30.475 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /host {"name": "smithi133"} 2023-08-07T20:40:30.526 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T20:40:30.534 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-07T20:40:30.570 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T20:40:30.570 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 10} 2023-08-07T20:40:30.573 DEBUG:teuthology.provision.fog.smithi133:Requesting image smithi_centos_9.stream (ID 10) 2023-08-07T20:40:30.573 DEBUG:teuthology.provision.fog.smithi133:FOG request: PUT /host/238 {"imageID": 10} 2023-08-07T20:40:30.608 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 9.stream 2023-08-07T20:40:30.608 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:40:30.619 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 9.stream 2023-08-07T20:40:30.619 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:40:30.669 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T20:40:30.675 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"} 2023-08-07T20:40:30.721 DEBUG:teuthology.provision.fog.smithi133:FOG request: POST /host/238/task {"taskTypeID": 1} 2023-08-07T20:40:30.724 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1} 2023-08-07T20:40:30.770 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:40:30.787 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:40:30.872 INFO:teuthology.orchestra.console.smithi107:Power off 2023-08-07T20:40:30.873 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:40:30.886 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-07T20:40:30.887 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T20:40:30.896 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-08-07T20:40:30.896 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:30.907 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-07T20:40:30.908 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:30.916 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T20:40:30.928 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-07T20:40:31.017 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-08-07T20:40:31.029 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-07T20:40:31.118 INFO:teuthology.orchestra.console.smithi107:Power on 2023-08-07T20:40:31.119 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T20:40:31.130 INFO:teuthology.orchestra.console.smithi133:Power on 2023-08-07T20:40:31.131 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-07T20:40:31.139 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On 2023-08-07T20:40:31.140 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:31.151 DEBUG:teuthology.orchestra.console.smithi133:power on output: Chassis Power Control: Up/On 2023-08-07T20:40:31.152 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:31.161 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T20:40:31.172 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-07T20:40:35.164 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:35.173 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:35.276 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on 2023-08-07T20:40:35.284 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-07T20:40:35.378 INFO:teuthology.orchestra.console.smithi107:Power on completed 2023-08-07T20:40:35.478 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2023-08-07T20:40:35.479 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:40:39.288 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T20:40:39.399 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-08-07T20:40:39.501 INFO:teuthology.orchestra.console.smithi133:Power on completed 2023-08-07T20:40:39.601 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2023-08-07T20:40:39.602 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:40:50.564 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:40:54.680 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:41:05.642 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:41:09.764 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:41:20.724 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:41:24.828 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:41:35.801 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:41:39.896 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:41:50.872 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:41:54.960 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:42:05.944 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:42:10.021 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:42:21.008 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:42:25.080 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:42:36.076 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:42:40.136 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:42:51.148 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:42:55.196 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:43:06.208 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:43:10.248 DEBUG:teuthology.provision.fog.smithi133:FOG request: GET /task/active None 2023-08-07T20:43:10.302 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:13.360 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:43:19.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:21.260 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None 2023-08-07T20:43:21.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:22.416 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:43:24.368 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:43:28.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:30.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:31.472 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:43:33.424 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:43:37.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:39.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:40.528 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:43:42.480 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:43:46.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:48.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:49.652 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:43:51.536 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:43:55.656 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:57.539 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:43:58.736 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:44:00.592 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:44:04.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:44:06.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:44:07.796 WARNING:teuthology.provision.fog.smithi133:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-08-07T20:44:09.648 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:44:13.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:44:15.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:44:18.736 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107 2023-08-07T20:44:24.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:45:13.842 WARNING:teuthology.provision.fog.smithi133:timed out 2023-08-07T20:45:19.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:45:20.129 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T20:45:20.130 DEBUG:teuthology.orchestra.run.smithi133:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T20:45:20.396 INFO:teuthology.provision.fog.smithi133:Node is ready 2023-08-07T20:45:20.396 DEBUG:teuthology.orchestra.run.smithi133:> hostname 2023-08-07T20:45:20.411 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2023-08-07T20:45:20.412 DEBUG:teuthology.orchestra.run.smithi133:> grep smithi133.front.sepia.ceph.com /etc/hosts 2023-08-07T20:45:20.465 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2023-08-07T20:45:20.466 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-07T20:45:20.597 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hosts 2023-08-07T20:45:20.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/172.21.15.133/172.21.15.133/g' /etc/hosts 2023-08-07T20:45:20.692 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i -e 's/smithi133.front.sepia.ceph.com/smithi133/g' /etc/hostname 2023-08-07T20:45:20.758 DEBUG:teuthology.orchestra.run.smithi133:> sudo hostname smithi133 2023-08-07T20:45:20.824 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-07T20:45:20.878 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-07T20:45:20.878 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2023-08-07T20:45:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-07T20:45:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:45:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2023-08-07T20:45:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:45:20.879 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:45:20.880 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:45:20.881 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:45:20.881 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2023-08-07T20:45:20.883 DEBUG:teuthology.parallel:result is None 2023-08-07T20:45:24.744 WARNING:teuthology.provision.fog.smithi107:timed out 2023-08-07T20:45:30.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:45:31.182 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-07T20:45:31.182 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-07T20:45:31.529 INFO:teuthology.provision.fog.smithi107:Node is ready 2023-08-07T20:45:31.530 DEBUG:teuthology.orchestra.run.smithi107:> hostname 2023-08-07T20:45:31.544 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2023-08-07T20:45:31.545 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107.front.sepia.ceph.com /etc/hosts 2023-08-07T20:45:31.600 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2023-08-07T20:45:31.600 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-08-07T20:45:31.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hosts 2023-08-07T20:45:31.753 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts 2023-08-07T20:45:31.820 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107.front.sepia.ceph.com/smithi107/g' /etc/hostname 2023-08-07T20:45:31.887 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107 2023-08-07T20:45:31.953 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-08-07T20:45:32.007 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-08-07T20:45:32.007 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:45:32.008 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:45:32.009 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:45:32.009 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2023-08-07T20:45:32.010 DEBUG:teuthology.parallel:result is None 2023-08-07T20:45:32.164 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2023-08-07T20:45:32.165 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T20:45:32.198 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2023-08-07T20:45:32.199 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-07T20:45:32.216 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2023-08-07T20:45:32.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-07T20:45:32.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:45:32.297 DEBUG:teuthology.orchestra.run.smithi107:> true 2023-08-07T20:45:32.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2023-08-07T20:45:32.362 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2023-08-07T20:45:32.416 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2023-08-07T20:45:32.416 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2023-08-07T20:45:32.470 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:45:32.471 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:45:32.472 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:45:32.472 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2023-08-07T20:45:32.490 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2023-08-07T20:45:32.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-07T20:45:32.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-07T20:45:32.573 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-08-07T20:45:32.746 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-08-07T20:45:32.747 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-08-07T20:45:32.801 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-08-07T20:45:32.801 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-08-07T20:45:32.855 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="9" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="9" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el9" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-07T20:45:32.856 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:LOGO="fedora-logo-icon" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-07T20:45:32.857 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-07T20:45:32.858 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-08-07T20:45:32.882 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:45:32.976 INFO:teuthology.dispatcher.supervisor:Running job 7361019 2023-08-07T20:45:32.976 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361019 --name rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} -- /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361019/orig.config.yaml 2023-08-07T20:45:32.979 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361019 2023-08-07T20:45:32.980 INFO:teuthology.dispatcher.supervisor:Job PID: 3004 2023-08-07T20:45:32.981 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-07T20:47:33.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:49:33.252 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:51:33.417 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:53:33.589 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:55:33.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:57:34.197 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T20:59:34.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:01:34.529 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:03:34.697 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:05:34.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:07:35.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:09:35.186 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:11:35.353 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:13:35.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:15:35.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:17:35.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:19:36.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:21:36.161 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:23:36.322 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:25:36.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:27:36.669 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:29:36.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:31:37.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:33:37.174 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:35:37.320 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:37:37.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:39:37.648 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:41:37.813 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:43:37.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:45:38.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:47:38.315 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:49:38.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:51:38.641 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:53:38.807 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:55:38.972 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:57:39.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T21:59:39.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:01:39.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:03:39.637 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:05:39.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:07:39.974 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:09:40.132 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:11:40.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:13:40.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:15:40.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:17:40.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:19:40.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:21:41.149 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:23:41.367 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:25:41.541 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:27:41.705 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:29:41.905 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:31:42.076 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:33:42.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:35:42.429 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:37:42.601 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:39:42.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:41:42.957 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:43:43.117 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:45:43.297 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:47:43.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:49:43.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:51:43.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:53:43.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:55:44.126 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:57:44.294 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T22:59:44.468 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:01:44.628 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:03:44.806 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:05:44.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:07:45.145 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:09:45.309 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:11:45.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-07T23:11:45.516 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-07T23:11:45.687 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-07T23:11:45.688 INFO:teuthology.nuke:Checking targets against current locks 2023-08-07T23:11:45.728 DEBUG:teuthology.nuke:shortname: smithi107 2023-08-07T23:11:45.729 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T23:11:45.749 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361019', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 20:40:29.452846', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAHXkjRm7f9I6M+QKCjfCSuPKt3R29AdDumkcxMMLJVJu4cLIxYkbOXzgF6RBYZ31aXjPHO/EGAH01hcb98cYY0='} 2023-08-07T23:11:45.757 DEBUG:teuthology.nuke:shortname: smithi133 2023-08-07T23:11:45.758 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-07T23:11:45.774 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-04_18:23:51-fs-wip-rishabh-2023aug3-testing-default-smithi/7361019', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-07 20:40:29.450930', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOb+FoZd+yPL+FCmkCAvZHfb8ZoxoEw1E36BZCtPAWdc3bNWo9IO/cb45TuG57KAqg/eoNcuM3Y+MNO3cySX9W4='} 2023-08-07T23:11:45.790 INFO:teuthology.orchestra.console.smithi107:Power off 2023-08-07T23:11:45.790 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T23:11:45.814 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off 2023-08-07T23:11:45.814 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T23:11:45.829 INFO:teuthology.orchestra.console.smithi133:Power off 2023-08-07T23:11:45.829 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-07T23:11:45.838 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off 2023-08-07T23:11:45.850 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-08-07T23:11:45.851 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-07T23:11:45.871 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-08-07T23:11:45.939 INFO:teuthology.orchestra.console.smithi107:Power off completed 2023-08-07T23:11:45.973 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-08-07T23:11:46.091 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2023-08-07T23:11:46.116 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com