2023-11-04T23:33:27.873 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-04T23:33:27.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:33:28.022 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbc753fe670>, signals=[15]) 2023-11-04T23:33:28.023 INFO:teuthology.lock.ops:Start node 'smithi033.front.sepia.ceph.com' reimaging 2023-11-04T23:33:28.024 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T23:33:28.024 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-04T23:33:28.044 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2023-11-04T23:33:28.045 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2023-11-04T23:33:28.045 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-11-04T23:33:28.047 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /host {"name": "smithi033"} 2023-11-04T23:33:28.069 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /host {"name": "smithi055"} 2023-11-04T23:33:28.130 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-04T23:33:28.138 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-04T23:33:28.179 DEBUG:teuthology.provision.fog.smithi033:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-04T23:33:28.179 DEBUG:teuthology.provision.fog.smithi033:FOG request: PUT /host/138 {"imageID": 6} 2023-11-04T23:33:28.182 DEBUG:teuthology.provision.fog.smithi055:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-04T23:33:28.183 DEBUG:teuthology.provision.fog.smithi055:FOG request: PUT /host/160 {"imageID": 6} 2023-11-04T23:33:28.228 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of ubuntu 22.04 2023-11-04T23:33:28.228 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:33:28.231 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of ubuntu 22.04 2023-11-04T23:33:28.231 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:33:28.298 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T23:33:28.303 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /tasktype {"name": "deploy"} 2023-11-04T23:33:28.341 DEBUG:teuthology.provision.fog.smithi055:FOG request: POST /host/160/task {"taskTypeID": 1} 2023-11-04T23:33:28.344 DEBUG:teuthology.provision.fog.smithi033:FOG request: POST /host/138/task {"taskTypeID": 1} 2023-11-04T23:33:28.469 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:33:28.483 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:33:28.572 INFO:teuthology.orchestra.console.smithi055:Power off 2023-11-04T23:33:28.573 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T23:33:28.585 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-04T23:33:28.586 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-04T23:33:28.598 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-11-04T23:33:28.599 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:28.606 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-04T23:33:28.607 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:28.621 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-11-04T23:33:28.627 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-04T23:33:32.626 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:32.633 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:32.736 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-11-04T23:33:32.743 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-04T23:33:36.738 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:36.745 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:36.848 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-11-04T23:33:36.855 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-04T23:33:36.950 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-11-04T23:33:36.956 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-04T23:33:37.051 INFO:teuthology.orchestra.console.smithi055:Power on 2023-11-04T23:33:37.051 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T23:33:37.059 INFO:teuthology.orchestra.console.smithi033:Power on 2023-11-04T23:33:37.060 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-04T23:33:37.073 DEBUG:teuthology.orchestra.console.smithi055:power on output: Chassis Power Control: Up/On 2023-11-04T23:33:37.074 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:37.082 DEBUG:teuthology.orchestra.console.smithi033:power on output: Chassis Power Control: Up/On 2023-11-04T23:33:37.083 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:37.095 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-11-04T23:33:37.103 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-04T23:33:41.098 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:41.106 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:41.208 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-11-04T23:33:41.215 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-04T23:33:45.210 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:45.218 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-04T23:33:45.320 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-11-04T23:33:45.329 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-11-04T23:33:45.421 INFO:teuthology.orchestra.console.smithi055:Power on completed 2023-11-04T23:33:45.430 INFO:teuthology.orchestra.console.smithi033:Power on completed 2023-11-04T23:33:45.523 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2023-11-04T23:33:45.523 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:33:45.532 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2023-11-04T23:33:45.532 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:34:00.610 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:34:00.612 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:34:15.686 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:34:15.688 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:34:30.774 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:34:30.775 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:34:45.846 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:34:45.848 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:35:00.922 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:35:00.924 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:35:15.994 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:35:15.996 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:35:31.063 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:35:31.064 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:35:46.162 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:35:46.164 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:36:01.250 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:36:01.253 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:36:16.338 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:36:16.340 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:36:31.426 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:36:31.428 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:36:46.510 DEBUG:teuthology.provision.fog.smithi033:FOG request: GET /task/active None 2023-11-04T23:36:46.512 DEBUG:teuthology.provision.fog.smithi055:FOG request: GET /task/active None 2023-11-04T23:36:46.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:36:46.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:36:49.659 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:36:49.660 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-04T23:36:55.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:36:55.669 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:36:58.746 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-04T23:36:58.747 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:37:04.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:04.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:07.802 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-04T23:37:07.803 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:37:13.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:13.809 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:16.858 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-04T23:37:16.890 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:37:22.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:22.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:25.950 WARNING:teuthology.provision.fog.smithi033:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-11-04T23:37:25.951 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:37:31.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:37:31.957 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:32.018 WARNING:teuthology.provision.fog.smithi033:timed out 2023-11-04T23:38:32.019 WARNING:teuthology.provision.fog.smithi055:timed out 2023-11-04T23:38:38.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:38.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:38.029 WARNING:teuthology.provision.fog.smithi055:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-11-04T23:38:38.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T23:38:38.225 DEBUG:teuthology.orchestra.run.smithi033:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T23:38:38.713 INFO:teuthology.provision.fog.smithi033:Node is ready 2023-11-04T23:38:38.714 DEBUG:teuthology.orchestra.run.smithi033:> hostname 2023-11-04T23:38:38.762 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2023-11-04T23:38:38.763 DEBUG:teuthology.orchestra.run.smithi033:> grep smithi033.front.sepia.ceph.com /etc/hosts 2023-11-04T23:38:38.810 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2023-11-04T23:38:38.811 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-04T23:38:38.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hosts 2023-11-04T23:38:38.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/172.21.15.33/172.21.15.33/g' /etc/hosts 2023-11-04T23:38:39.035 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i -e 's/smithi033.front.sepia.ceph.com/smithi033/g' /etc/hostname 2023-11-04T23:38:39.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname smithi033 2023-11-04T23:38:39.150 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-04T23:38:39.199 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T23:38:39.199 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-11-04T23:38:39.199 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-11-04T23:38:39.199 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T23:38:39.200 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-11-04T23:38:39.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-11-04T23:38:39.200 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-11-04T23:38:39.200 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:38:39.201 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:38:39.201 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:38:39.201 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:38:39.201 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-11-04T23:38:39.202 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2023-11-04T23:38:39.203 DEBUG:teuthology.parallel:result is None 2023-11-04T23:38:44.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:44.250 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-04T23:38:44.251 DEBUG:teuthology.orchestra.run.smithi055:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-04T23:38:44.711 INFO:teuthology.provision.fog.smithi055:Node is ready 2023-11-04T23:38:44.711 DEBUG:teuthology.orchestra.run.smithi055:> hostname 2023-11-04T23:38:44.756 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2023-11-04T23:38:44.757 DEBUG:teuthology.orchestra.run.smithi055:> grep smithi055.front.sepia.ceph.com /etc/hosts 2023-11-04T23:38:44.810 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2023-11-04T23:38:44.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-11-04T23:38:44.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hosts 2023-11-04T23:38:44.992 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/172.21.15.55/172.21.15.55/g' /etc/hosts 2023-11-04T23:38:45.049 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i -e 's/smithi055.front.sepia.ceph.com/smithi055/g' /etc/hostname 2023-11-04T23:38:45.105 DEBUG:teuthology.orchestra.run.smithi055:> sudo hostname smithi055 2023-11-04T23:38:45.161 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-11-04T23:38:45.209 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T23:38:45.210 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2023-11-04T23:38:45.210 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="22.04" 2023-11-04T23:38:45.210 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T23:38:45.210 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=jammy 2023-11-04T23:38:45.211 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2023-11-04T23:38:45.211 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2023-11-04T23:38:45.211 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:38:45.211 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:38:45.211 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:38:45.212 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:38:45.212 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=jammy 2023-11-04T23:38:45.212 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2023-11-04T23:38:45.212 DEBUG:teuthology.parallel:result is None 2023-11-04T23:38:45.399 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2023-11-04T23:38:45.400 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T23:38:45.424 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2023-11-04T23:38:45.424 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-04T23:38:45.450 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2023-11-04T23:38:45.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-04T23:38:45.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:45.528 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-11-04T23:38:45.634 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-11-04T23:38:45.635 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-11-04T23:38:45.681 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-11-04T23:38:45.682 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-11-04T23:38:45.730 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T23:38:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2023-11-04T23:38:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="22.04" 2023-11-04T23:38:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T23:38:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=jammy 2023-11-04T23:38:45.731 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2023-11-04T23:38:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2023-11-04T23:38:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:38:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:38:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:38:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:38:45.733 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=jammy 2023-11-04T23:38:45.733 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-11-04T23:38:45.757 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2023-11-04T23:38:45.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-11-04T23:38:45.758 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-04T23:38:45.835 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-11-04T23:38:45.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-11-04T23:38:45.946 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-11-04T23:38:45.992 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-11-04T23:38:45.993 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-11-04T23:38:46.040 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-04T23:38:46.040 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2023-11-04T23:38:46.040 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="22.04" 2023-11-04T23:38:46.041 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-04T23:38:46.041 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=jammy 2023-11-04T23:38:46.041 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2023-11-04T23:38:46.041 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2023-11-04T23:38:46.041 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-04T23:38:46.042 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-04T23:38:46.042 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-04T23:38:46.042 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-04T23:38:46.042 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=jammy 2023-11-04T23:38:46.043 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-11-04T23:38:46.066 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:38:46.157 INFO:teuthology.dispatcher.supervisor:Running job 7447361 2023-11-04T23:38:46.158 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447361 --name yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/ffsb}} -- /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447361/orig.config.yaml 2023-11-04T23:38:46.161 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447361 2023-11-04T23:38:46.162 INFO:teuthology.dispatcher.supervisor:Job PID: 1953543 2023-11-04T23:38:46.162 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-04T23:40:46.163 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:42:46.237 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:44:46.314 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:46:46.393 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:48:46.469 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:50:46.533 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:52:46.592 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:54:46.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:56:46.716 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-04T23:58:46.784 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:00:46.856 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:02:46.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:04:46.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:06:47.063 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:08:47.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-05T00:08:47.301 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-05T00:08:47.422 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-05T00:08:47.423 INFO:teuthology.nuke:Checking targets against current locks 2023-11-05T00:08:47.469 DEBUG:teuthology.nuke:shortname: smithi033 2023-11-05T00:08:47.469 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:08:47.491 DEBUG:teuthology.nuke:shortname: smithi055 2023-11-05T00:08:47.491 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-05T00:08:47.495 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 23:33:27.041152', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHtC5r6Lp53q+xnFHIyM2Zp5E01LJh5hEnGW5AxqRgFI2UF41rtpuIwRrcD8lp8kfwdzUu6JHG4BYQ5stqPKrkQ='} 2023-11-05T00:08:47.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-04_11:32:36-fs-wip-yuri-testing-2023-11-01-1538-reef-distro-default-smithi/7447361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-04 23:33:27.042551', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLOPloxifDjLcHJwRWIeO9/XQX507BmELU7zfEOVZzn6DdaLsItrqcm9DY1N/DVqXI24PfsMdcbJsbUhG+4krVk='} 2023-11-05T00:08:47.539 INFO:teuthology.orchestra.console.smithi033:Power off 2023-11-05T00:08:47.540 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:08:47.564 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-11-05T00:08:47.564 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:08:47.580 INFO:teuthology.orchestra.console.smithi055:Power off 2023-11-05T00:08:47.580 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-05T00:08:47.589 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-11-05T00:08:47.602 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-11-05T00:08:47.603 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-05T00:08:47.626 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-11-05T00:08:47.691 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-11-05T00:08:47.728 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-11-05T00:08:47.841 INFO:teuthology.lock.ops:unlocked: smithi033.front.sepia.ceph.com 2023-11-05T00:08:47.874 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com