2023-11-03T11:40:55.134 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-03T11:40:55.136 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:40:55.246 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f068803a670>, signals=[15]) 2023-11-03T11:40:55.247 INFO:teuthology.lock.ops:Start node 'smithi072.front.sepia.ceph.com' reimaging 2023-11-03T11:40:55.248 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: reset os type and version on server 2023-11-03T11:40:55.248 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-03T11:40:55.269 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /host {"name": "smithi072"} 2023-11-03T11:40:55.345 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /image {"name": "smithi_ubuntu_22.04"} 2023-11-03T11:40:55.386 DEBUG:teuthology.provision.fog.smithi072:Requesting image smithi_ubuntu_22.04 (ID 6) 2023-11-03T11:40:55.387 DEBUG:teuthology.provision.fog.smithi072:FOG request: PUT /host/177 {"imageID": 6} 2023-11-03T11:40:55.435 INFO:teuthology.provision.fog.smithi072:Scheduling deploy of ubuntu 22.04 2023-11-03T11:40:55.436 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:40:55.501 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /tasktype {"name": "deploy"} 2023-11-03T11:40:55.539 DEBUG:teuthology.provision.fog.smithi072:FOG request: POST /host/177/task {"taskTypeID": 1} 2023-11-03T11:40:55.593 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:40:55.680 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-03T11:40:55.683 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T11:40:55.707 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-03T11:40:55.708 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:40:55.732 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-03T11:40:59.735 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:40:59.844 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-03T11:41:03.849 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:41:03.958 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-03T11:41:04.059 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-03T11:41:04.160 INFO:teuthology.orchestra.console.smithi072:Power on 2023-11-03T11:41:04.160 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-11-03T11:41:04.182 DEBUG:teuthology.orchestra.console.smithi072:power on output: Chassis Power Control: Up/On 2023-11-03T11:41:04.183 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:41:04.205 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-03T11:41:08.210 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:41:08.319 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-03T11:41:12.322 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T11:41:12.433 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-11-03T11:41:12.534 INFO:teuthology.orchestra.console.smithi072:Power on completed 2023-11-03T11:41:12.635 INFO:teuthology.provision.fog.smithi072:Waiting for deploy to finish 2023-11-03T11:41:12.635 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:41:27.718 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:41:42.798 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:41:57.866 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:42:12.950 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:42:28.022 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:42:43.100 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:42:58.177 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:43:13.266 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:43:28.347 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:43:43.426 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:43:58.502 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:44:13.590 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:44:28.678 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:44:43.758 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:44:58.862 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:45:13.950 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:45:29.026 DEBUG:teuthology.provision.fog.smithi072:FOG request: GET /task/active None 2023-11-03T11:45:29.087 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:45:32.154 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:45:38.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:45:41.210 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:45:47.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:45:50.270 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:45:56.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:45:59.354 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:46:05.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:46:08.410 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:46:14.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:46:17.466 WARNING:teuthology.provision.fog.smithi072:[Errno None] Unable to connect to port 22 on 172.21.15.72 2023-11-03T11:46:23.470 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:47:23.532 WARNING:teuthology.provision.fog.smithi072:timed out 2023-11-03T11:47:29.541 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:47:29.758 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-11-03T11:47:29.759 DEBUG:teuthology.orchestra.run.smithi072:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-11-03T11:47:30.327 INFO:teuthology.provision.fog.smithi072:Node is ready 2023-11-03T11:47:30.327 DEBUG:teuthology.orchestra.run.smithi072:> hostname 2023-11-03T11:47:30.375 INFO:teuthology.orchestra.run.smithi072.stdout:smithi072.front.sepia.ceph.com 2023-11-03T11:47:30.376 DEBUG:teuthology.orchestra.run.smithi072:> grep smithi072.front.sepia.ceph.com /etc/hosts 2023-11-03T11:47:30.424 INFO:teuthology.orchestra.run.smithi072.stdout:172.21.15.72 smithi072.front.sepia.ceph.com smithi072 2023-11-03T11:47:30.424 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-03T11:47:30.618 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hosts 2023-11-03T11:47:30.633 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/172.21.15.72/172.21.15.72/g' /etc/hosts 2023-11-03T11:47:30.687 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i -e 's/smithi072.front.sepia.ceph.com/smithi072/g' /etc/hostname 2023-11-03T11:47:30.748 DEBUG:teuthology.orchestra.run.smithi072:> sudo hostname smithi072 2023-11-03T11:47:30.807 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-03T11:47:30.856 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T11:47:30.856 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-11-03T11:47:30.856 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2023-11-03T11:47:30.856 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T11:47:30.857 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2023-11-03T11:47:30.857 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-11-03T11:47:30.857 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-11-03T11:47:30.857 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T11:47:30.858 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T11:47:30.858 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T11:47:30.858 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T11:47:30.858 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2023-11-03T11:47:30.859 INFO:teuthology.provision.fog.smithi072:Deploy complete! 2023-11-03T11:47:30.860 DEBUG:teuthology.parallel:result is None 2023-11-03T11:47:30.986 INFO:teuthology.lock.ops:Checking smithi072.front.sepia.ceph.com 2023-11-03T11:47:30.986 INFO:teuthology.lock.ops:New key found. Updating... 2023-11-03T11:47:31.008 INFO:teuthology.lock.ops:Updating [smithi072.front.sepia.ceph.com]: set os type and version on server 2023-11-03T11:47:31.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-03T11:47:31.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-03T11:47:31.086 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-11-03T11:47:31.183 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-11-03T11:47:31.183 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-11-03T11:47:31.235 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-11-03T11:47:31.236 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-11-03T11:47:31.283 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-03T11:47:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Ubuntu" 2023-11-03T11:47:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="22.04" 2023-11-03T11:47:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-03T11:47:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_CODENAME=jammy 2023-11-03T11:47:31.284 INFO:teuthology.orchestra.run.smithi072.stdout:ID=ubuntu 2023-11-03T11:47:31.285 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE=debian 2023-11-03T11:47:31.285 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-03T11:47:31.285 INFO:teuthology.orchestra.run.smithi072.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-03T11:47:31.285 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-03T11:47:31.285 INFO:teuthology.orchestra.run.smithi072.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-03T11:47:31.286 INFO:teuthology.orchestra.run.smithi072.stdout:UBUNTU_CODENAME=jammy 2023-11-03T11:47:31.286 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-11-03T11:47:31.310 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:47:31.412 INFO:teuthology.dispatcher.supervisor:Running job 7445196 2023-11-03T11:47:31.413 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_sseshasa@teuthology --archive /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445196 --name sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi --description rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445196/orig.config.yaml 2023-11-03T11:47:31.416 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445196 2023-11-03T11:47:31.416 INFO:teuthology.dispatcher.supervisor:Job PID: 1848411 2023-11-03T11:47:31.416 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-11-03T11:49:31.514 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:51:31.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:53:31.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:55:32.027 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:57:32.191 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T11:59:32.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:01:32.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:03:32.684 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-03T12:03:32.752 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-11-03T12:03:32.832 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-11-03T12:03:32.833 INFO:teuthology.nuke:Checking targets against current locks 2023-11-03T12:03:32.880 DEBUG:teuthology.nuke:shortname: smithi072 2023-11-03T12:03:32.881 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-03T12:03:32.900 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/sseshasa-2023-11-03_06:54:32-rados-wip-sseshasa-testing-2023-11-02-1957-distro-default-smithi/7445196', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-03 11:40:54.335410', 'locked_by': 'scheduled_sseshasa@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGhyy1xPkSOCZ4WKMcxJ33eR6p6HxZEqraJ/09IYhurQdOqFYLzSUCXytKgKr2QyXUhdju5s+Zd3orO8rRmy+Lw='} 2023-11-03T12:03:32.951 INFO:teuthology.orchestra.console.smithi072:Power off 2023-11-03T12:03:32.952 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-03T12:03:32.976 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-11-03T12:03:32.977 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-03T12:03:33.001 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-11-03T12:03:33.102 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-11-03T12:03:33.258 INFO:teuthology.lock.ops:unlocked: smithi072.front.sepia.ceph.com