2024-01-23T08:19:47.017 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-23T08:19:47.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:19:47.121 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf1cfccc10>, signals=[15]) 2024-01-23T08:19:47.122 INFO:teuthology.lock.ops:Start node 'smithi169.front.sepia.ceph.com' reimaging 2024-01-23T08:19:47.122 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: reset os type and version on server 2024-01-23T08:19:47.122 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-01-23T08:19:47.255 DEBUG:teuthology.provision.fog.smithi169:Requesting image smithi_centos_8.stream (ID 3) 2024-01-23T08:19:47.294 INFO:teuthology.provision.fog.smithi169:Scheduling deploy of centos 8.stream 2024-01-23T08:19:47.545 INFO:teuthology.orchestra.console.smithi169:Power off 2024-01-23T08:19:47.545 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T08:19:47.565 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-01-23T08:19:47.566 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:19:47.585 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-23T08:19:47.686 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-01-23T08:19:47.786 INFO:teuthology.orchestra.console.smithi169:Power on 2024-01-23T08:19:47.786 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-23T08:19:47.810 DEBUG:teuthology.orchestra.console.smithi169:power on output: Chassis Power Control: Up/On 2024-01-23T08:19:47.810 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:19:47.831 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-23T08:19:51.832 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:19:51.941 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-23T08:19:55.944 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:19:56.053 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-01-23T08:19:56.153 INFO:teuthology.orchestra.console.smithi169:Power on completed 2024-01-23T08:19:56.254 INFO:teuthology.provision.fog.smithi169:Waiting for deploy to finish 2024-01-23T08:22:42.285 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:00.669 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:06.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:09.756 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:15.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:18.812 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:24.819 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:27.904 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:33.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:36.988 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:42.992 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:23:46.044 WARNING:teuthology.provision.fog.smithi169:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-01-23T08:23:52.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:24:52.101 WARNING:teuthology.provision.fog.smithi169:timed out 2024-01-23T08:24:58.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:24:58.342 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-23T08:24:58.343 DEBUG:teuthology.orchestra.run.smithi169:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-23T08:24:58.584 INFO:teuthology.provision.fog.smithi169:Node is ready 2024-01-23T08:24:58.585 DEBUG:teuthology.orchestra.run.smithi169:> hostname 2024-01-23T08:24:58.604 INFO:teuthology.orchestra.run.smithi169.stdout:smithi169.front.sepia.ceph.com 2024-01-23T08:24:58.604 DEBUG:teuthology.orchestra.run.smithi169:> grep smithi169.front.sepia.ceph.com /etc/hosts 2024-01-23T08:24:58.663 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.15.169 smithi169.front.sepia.ceph.com smithi169 2024-01-23T08:24:58.663 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-01-23T08:24:58.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hosts 2024-01-23T08:24:58.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/172.21.15.169/172.21.15.169/g' /etc/hosts 2024-01-23T08:24:58.860 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i -e 's/smithi169.front.sepia.ceph.com/smithi169/g' /etc/hostname 2024-01-23T08:24:58.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo hostname smithi169 2024-01-23T08:24:58.994 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2024-01-23T08:24:59.053 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T08:24:59.054 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T08:24:59.055 INFO:teuthology.provision.fog.smithi169:Deploy complete! 2024-01-23T08:24:59.056 DEBUG:teuthology.parallel:result is None 2024-01-23T08:24:59.169 INFO:teuthology.lock.ops:Checking smithi169.front.sepia.ceph.com 2024-01-23T08:24:59.169 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-23T08:24:59.193 INFO:teuthology.lock.ops:Updating [smithi169.front.sepia.ceph.com]: set os type and version on server 2024-01-23T08:24:59.193 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-23T08:24:59.194 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-23T08:24:59.264 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-01-23T08:24:59.329 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-01-23T08:24:59.329 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-01-23T08:24:59.387 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-01-23T08:24:59.387 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="8" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="8" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el8" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-01-23T08:24:59.445 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-23T08:24:59.446 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-01-23T08:24:59.446 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-23T08:24:59.446 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-23T08:24:59.446 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-23T08:24:59.446 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-01-23T08:24:59.466 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:24:59.557 INFO:teuthology.dispatcher.supervisor:Running job 7527394 2024-01-23T08:24:59.557 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/virtualenv/bin/teuthology -v --owner scheduled_cbodley@teuthology --archive /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527394 --name cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi --description fs/upgrade/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} -- /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527394/orig.config.yaml 2024-01-23T08:24:59.560 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527394 2024-01-23T08:24:59.560 INFO:teuthology.dispatcher.supervisor:Job PID: 2297370 2024-01-23T08:24:59.560 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-23T08:26:59.661 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:28:59.837 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:31:00.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:33:00.179 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:35:00.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:37:00.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:39:00.615 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:41:00.792 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:43:00.975 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:45:01.142 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:47:01.313 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-23T08:47:01.381 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-23T08:47:01.468 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-23T08:47:01.468 INFO:teuthology.nuke:Checking targets against current locks 2024-01-23T08:47:01.518 DEBUG:teuthology.nuke:shortname: smithi169 2024-01-23T08:47:01.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-23T08:47:01.541 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-01-22_19:46:51-fs-wip-yuri8-testing-2024-01-18-0823-distro-default-smithi/7527394', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-23 08:19:46.012256', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEwL6h4t0t6bDnAww5pa5UiPYe7r6+rPB2s0uy62LRU+SjWvFcbX8K7zymvEdpm44cLVE1TkAUv6M+aY47QbNz4='} 2024-01-23T08:47:01.592 INFO:teuthology.orchestra.console.smithi169:Power off 2024-01-23T08:47:01.593 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-23T08:47:01.614 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-01-23T08:47:01.615 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-23T08:47:01.635 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-01-23T08:47:01.736 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-01-23T08:47:01.888 INFO:teuthology.lock.ops:unlocked: smithi169.front.sepia.ceph.com