2023-08-08T21:15:45.720 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-08T21:15:45.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:15:45.858 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4a7d3bee50>, signals=[15]) 2023-08-08T21:15:45.860 INFO:teuthology.lock.ops:Start node 'smithi012.front.sepia.ceph.com' reimaging 2023-08-08T21:15:45.860 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T21:15:45.860 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-08T21:15:45.888 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2023-08-08T21:15:45.888 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2023-08-08T21:15:45.889 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-08-08T21:15:45.890 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /host {"name": "smithi012"} 2023-08-08T21:15:45.913 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /host {"name": "smithi027"} 2023-08-08T21:15:45.962 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T21:15:45.985 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /image {"name": "smithi_centos_9.stream"} 2023-08-08T21:15:46.003 DEBUG:teuthology.provision.fog.smithi012:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T21:15:46.003 DEBUG:teuthology.provision.fog.smithi012:FOG request: PUT /host/118 {"imageID": 10} 2023-08-08T21:15:46.025 DEBUG:teuthology.provision.fog.smithi027:Requesting image smithi_centos_9.stream (ID 10) 2023-08-08T21:15:46.025 DEBUG:teuthology.provision.fog.smithi027:FOG request: PUT /host/132 {"imageID": 10} 2023-08-08T21:15:46.050 INFO:teuthology.provision.fog.smithi012:Scheduling deploy of centos 9.stream 2023-08-08T21:15:46.050 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:15:46.076 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of centos 9.stream 2023-08-08T21:15:46.077 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:15:46.095 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T21:15:46.122 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /tasktype {"name": "deploy"} 2023-08-08T21:15:46.128 DEBUG:teuthology.provision.fog.smithi012:FOG request: POST /host/118/task {"taskTypeID": 1} 2023-08-08T21:15:46.152 DEBUG:teuthology.provision.fog.smithi027:FOG request: POST /host/132/task {"taskTypeID": 1} 2023-08-08T21:15:46.198 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:15:46.206 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:15:46.283 INFO:teuthology.orchestra.console.smithi027:Power off 2023-08-08T21:15:46.284 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:15:46.300 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-08T21:15:46.300 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:15:46.312 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-08-08T21:15:46.313 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:46.325 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-08T21:15:46.325 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:46.335 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-08-08T21:15:46.352 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T21:15:50.340 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:50.354 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:50.451 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-08-08T21:15:50.464 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T21:15:54.452 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:54.465 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:54.563 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-08-08T21:15:54.576 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T21:15:54.677 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-08T21:15:54.778 INFO:teuthology.orchestra.console.smithi012:Power on 2023-08-08T21:15:54.778 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T21:15:54.802 DEBUG:teuthology.orchestra.console.smithi012:power on output: Chassis Power Control: Up/On 2023-08-08T21:15:54.803 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:54.846 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T21:15:58.567 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:58.676 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-08-08T21:15:58.777 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-08-08T21:15:58.847 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:58.879 INFO:teuthology.orchestra.console.smithi027:Power on 2023-08-08T21:15:58.880 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-08-08T21:15:58.900 DEBUG:teuthology.orchestra.console.smithi027:power on output: Chassis Power Control: Up/On 2023-08-08T21:15:58.901 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:15:58.922 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-08-08T21:15:58.958 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T21:16:02.924 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:16:02.960 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:16:03.035 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-08-08T21:16:03.071 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-08T21:16:03.172 INFO:teuthology.orchestra.console.smithi012:Power on completed 2023-08-08T21:16:03.272 INFO:teuthology.provision.fog.smithi012:Waiting for deploy to finish 2023-08-08T21:16:03.273 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:16:07.040 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:16:07.151 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is on 2023-08-08T21:16:07.252 INFO:teuthology.orchestra.console.smithi027:Power on completed 2023-08-08T21:16:07.353 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2023-08-08T21:16:07.354 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:16:18.340 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:16:22.412 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:16:33.412 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:16:37.470 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:16:48.480 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:16:52.534 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:17:03.541 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:17:07.593 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:17:18.608 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:17:22.668 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:17:33.672 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:17:37.728 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:17:48.744 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:17:52.792 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:18:03.832 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:18:07.864 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:18:18.908 DEBUG:teuthology.provision.fog.smithi012:FOG request: GET /task/active None 2023-08-08T21:18:18.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:18:22.037 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:18:22.935 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:18:28.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:18:31.120 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:18:37.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:18:38.011 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:18:40.176 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:18:46.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:18:49.232 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:18:53.084 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:18:55.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:18:58.288 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:19:04.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:19:08.164 DEBUG:teuthology.provision.fog.smithi027:FOG request: GET /task/active None 2023-08-08T21:19:08.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:19:08.300 ERROR:teuthology.orchestra.connection:Error authenticating with smithi027.front.sepia.ceph.com: Authentication failed. 2023-08-08T21:19:08.302 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T21:19:08.303 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T21:19:08.304 WARNING:paramiko.transport:Oops, unhandled type 3 ('unimplemented') 2023-08-08T21:19:22.740 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:19:28.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:19:31.792 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:19:37.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:19:40.848 WARNING:teuthology.provision.fog.smithi012:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-08T21:19:46.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:19:47.115 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T21:19:47.116 DEBUG:teuthology.orchestra.run.smithi012:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T21:19:57.422 INFO:teuthology.provision.fog.smithi012:Node is ready 2023-08-08T21:19:57.422 DEBUG:teuthology.orchestra.run.smithi012:> hostname 2023-08-08T21:19:57.440 INFO:teuthology.orchestra.run.smithi012.stdout:smithi012.front.sepia.ceph.com 2023-08-08T21:19:57.441 DEBUG:teuthology.orchestra.run.smithi012:> grep smithi012.front.sepia.ceph.com /etc/hosts 2023-08-08T21:19:57.504 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.15.12 smithi012.front.sepia.ceph.com smithi012 2023-08-08T21:19:57.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-08T21:19:57.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hosts 2023-08-08T21:19:57.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/172.21.15.12/172.21.15.12/g' /etc/hosts 2023-08-08T21:19:57.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i -e 's/smithi012.front.sepia.ceph.com/smithi012/g' /etc/hostname 2023-08-08T21:19:57.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo hostname smithi012 2023-08-08T21:19:57.872 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-08T21:19:57.927 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-08T21:19:57.928 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-08-08T21:19:57.928 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-08T21:19:57.928 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-08T21:19:57.928 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-08-08T21:19:57.928 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-08-08T21:19:57.929 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T21:19:57.929 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-08T21:19:57.929 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-08-08T21:19:57.929 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T21:19:57.930 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T21:19:57.931 INFO:teuthology.provision.fog.smithi012:Deploy complete! 2023-08-08T21:19:57.932 DEBUG:teuthology.parallel:result is None 2023-08-08T21:21:53.776 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-08-08T21:21:53.778 ERROR:teuthology.provision.fog:[Errno 104] Connection reset by peer on smithi027 2023-08-08T21:22:02.784 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-08-08T21:22:02.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:22:03.057 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-08-08T21:22:03.472 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-08-08T21:22:03.473 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-08-08T21:22:03.473 DEBUG:teuthology.orchestra.run.smithi027:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-08-08T21:22:03.487 INFO:teuthology.provision.fog.smithi027:Node is ready 2023-08-08T21:22:03.487 DEBUG:teuthology.orchestra.run.smithi027:> hostname 2023-08-08T21:22:03.542 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2023-08-08T21:22:03.543 DEBUG:teuthology.orchestra.run.smithi027:> grep smithi027.front.sepia.ceph.com /etc/hosts 2023-08-08T21:22:03.596 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2023-08-08T21:22:03.597 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-08-08T21:22:03.736 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hosts 2023-08-08T21:22:03.767 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/172.21.15.27/172.21.15.27/g' /etc/hosts 2023-08-08T21:22:03.838 DEBUG:teuthology.orchestra.run.smithi027:> sudo sed -i -e 's/smithi027.front.sepia.ceph.com/smithi027/g' /etc/hostname 2023-08-08T21:22:03.909 DEBUG:teuthology.orchestra.run.smithi027:> sudo hostname smithi027 2023-08-08T21:22:03.979 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-08-08T21:22:04.033 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2023-08-08T21:22:04.034 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T21:22:04.035 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T21:22:04.036 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2023-08-08T21:22:04.036 DEBUG:teuthology.parallel:result is None 2023-08-08T21:22:04.177 INFO:teuthology.lock.ops:Checking smithi012.front.sepia.ceph.com 2023-08-08T21:22:04.178 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T21:22:04.204 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2023-08-08T21:22:04.204 INFO:teuthology.lock.ops:New key found. Updating... 2023-08-08T21:22:04.229 INFO:teuthology.lock.ops:Updating [smithi012.front.sepia.ceph.com]: set os type and version on server 2023-08-08T21:22:04.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-08T21:22:04.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:22:04.330 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-08T21:22:04.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-08T21:22:04.519 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-08-08T21:22:04.573 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-08-08T21:22:04.574 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-08T21:22:04.628 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="CentOS Stream" 2023-08-08T21:22:04.628 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="9" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:ID="centos" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="rhel fedora" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="9" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el9" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T21:22:04.629 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:LOGO="fedora-logo-icon" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://centos.org/" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T21:22:04.630 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T21:22:04.631 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-08T21:22:04.653 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2023-08-08T21:22:04.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-08-08T21:22:04.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi027.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-08T21:22:04.749 DEBUG:teuthology.orchestra.run.smithi027:> true 2023-08-08T21:22:04.814 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi027.front.sepia.ceph.com' 2023-08-08T21:22:04.815 DEBUG:teuthology.orchestra.run.smithi027:> uname -m 2023-08-08T21:22:04.870 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2023-08-08T21:22:04.870 DEBUG:teuthology.orchestra.run.smithi027:> cat /etc/os-release 2023-08-08T21:22:04.924 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="CentOS Stream" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="9" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:ID="centos" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="rhel fedora" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="9" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el9" 2023-08-08T21:22:04.925 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="CentOS Stream 9" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:LOGO="fedora-logo-icon" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://centos.org/" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-08-08T21:22:04.926 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-08T21:22:04.927 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2023-08-08T21:22:04.945 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:22:05.035 INFO:teuthology.dispatcher.supervisor:Running job 7363384 2023-08-08T21:22:05.035 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/virtualenv/bin/teuthology -v --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7363384 --name rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/upgrade/upgraded_client/{bluestore-bitmap centos_latest clusters/{1-mds-1-client-micro} conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-from/pacific 1-mount/mount/fuse 2-workload/new_ops/{0-clients/fuse-upgrade 1-client-sanity}}} -- /home/teuthworker/archive/rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7363384/orig.config.yaml 2023-08-08T21:22:05.039 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7363384 2023-08-08T21:22:05.040 INFO:teuthology.dispatcher.supervisor:Job PID: 17500 2023-08-08T21:22:05.040 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-08-08T21:24:05.140 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:26:05.209 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:28:05.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:30:05.546 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:32:05.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:34:05.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:36:06.021 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:38:06.185 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:40:06.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-08T21:40:06.410 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-08-08T21:40:06.513 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-08-08T21:40:06.513 INFO:teuthology.nuke:Checking targets against current locks 2023-08-08T21:40:06.561 DEBUG:teuthology.nuke:shortname: smithi012 2023-08-08T21:40:06.561 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T21:40:06.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7363384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 21:15:44.870111', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPrVkigDLxL3O/O62u5e9tFGe0A0/e26MEbFSwbN33NQwOcNcpUOO6zEXz8/6/A61oQIC/MWl01MuxPVIbbtB8I='} 2023-08-08T21:40:06.590 DEBUG:teuthology.nuke:shortname: smithi027 2023-08-08T21:40:06.590 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-08T21:40:06.614 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi027.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-08_20:08:30-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7363384', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-08 21:15:44.868616', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLMY/3h+2zZeDbxz9ZszkZ269ytXINCMXaJsz1FF8gnkemffuhxXoTXoX6oyikYyAmTHeBIdsdZrSnYtlx2R4yk='} 2023-08-08T21:40:06.642 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-08T21:40:06.643 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:40:06.665 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-08T21:40:06.665 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:40:06.685 INFO:teuthology.orchestra.console.smithi027:Power off 2023-08-08T21:40:06.686 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-08T21:40:06.696 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-08T21:40:06.707 DEBUG:teuthology.orchestra.console.smithi027:power off output: Chassis Power Control: Down/Off 2023-08-08T21:40:06.707 DEBUG:teuthology.orchestra.console.smithi027:pexpect command: ipmitool -H smithi027.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-08T21:40:06.727 DEBUG:teuthology.orchestra.console.smithi027:check power output: Chassis Power is off 2023-08-08T21:40:06.798 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-08T21:40:06.829 INFO:teuthology.orchestra.console.smithi027:Power off completed 2023-08-08T21:40:06.952 INFO:teuthology.lock.ops:unlocked: smithi012.front.sepia.ceph.com 2023-08-08T21:40:06.976 INFO:teuthology.lock.ops:unlocked: smithi027.front.sepia.ceph.com