2024-02-21T20:43:21.757 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-21T20:43:21.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T20:43:21.900 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f59ce2a0c10>, signals=[15]) 2024-02-21T20:43:21.900 INFO:teuthology.lock.ops:Start node 'smithi162.front.sepia.ceph.com' reimaging 2024-02-21T20:43:21.900 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: reset os type and version on server 2024-02-21T20:43:21.901 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-21T20:43:22.011 DEBUG:teuthology.provision.fog.smithi162:Requesting image smithi_centos_8.stream (ID 3) 2024-02-21T20:43:22.060 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of centos 8.stream 2024-02-21T20:43:22.657 INFO:teuthology.orchestra.console.smithi162:Power off 2024-02-21T20:43:22.657 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-21T20:43:22.678 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-02-21T20:43:22.679 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:22.702 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T20:43:26.707 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:26.816 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T20:43:30.820 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:30.928 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T20:43:34.932 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:35.041 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-21T20:43:35.141 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-02-21T20:43:35.242 INFO:teuthology.orchestra.console.smithi162:Power on 2024-02-21T20:43:35.242 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-21T20:43:35.262 DEBUG:teuthology.orchestra.console.smithi162:power on output: Chassis Power Control: Up/On 2024-02-21T20:43:35.263 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:35.284 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-02-21T20:43:39.288 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-21T20:43:39.396 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-02-21T20:43:39.497 INFO:teuthology.orchestra.console.smithi162:Power on completed 2024-02-21T20:43:39.597 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2024-02-21T20:51:54.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:51:57.152 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:03.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:52:06.240 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:12.244 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:52:15.328 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:21.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:52:24.416 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:30.421 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:52:33.500 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:39.504 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:52:42.560 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:52:48.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:53:07.004 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:53:13.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:53:16.060 WARNING:teuthology.provision.fog.smithi162:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-02-21T20:53:22.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:53:23.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-21T20:53:23.246 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-21T20:53:48.988 INFO:teuthology.provision.fog.smithi162:Node is ready 2024-02-21T20:53:48.989 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2024-02-21T20:53:49.013 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2024-02-21T20:53:49.013 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2024-02-21T20:53:49.074 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2024-02-21T20:53:49.074 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-21T20:53:49.199 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2024-02-21T20:53:49.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2024-02-21T20:53:49.302 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2024-02-21T20:53:49.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2024-02-21T20:53:49.442 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-21T20:53:49.500 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-21T20:53:49.500 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2024-02-21T20:53:49.500 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-21T20:53:49.501 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T20:53:49.502 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2024-02-21T20:53:49.503 DEBUG:teuthology.parallel:result is None 2024-02-21T20:53:49.703 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2024-02-21T20:53:49.703 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-21T20:53:49.786 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2024-02-21T20:53:49.786 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-21T20:53:49.787 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-21T20:53:49.872 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-02-21T20:53:49.898 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-02-21T20:53:49.898 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-02-21T20:53:49.956 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-02-21T20:53:49.957 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="8" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="8" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el8" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-02-21T20:53:50.015 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-21T20:53:50.016 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-02-21T20:53:50.016 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-21T20:53:50.016 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-21T20:53:50.016 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-21T20:53:50.016 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-02-21T20:53:50.054 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T20:53:50.169 INFO:teuthology.dispatcher.supervisor:Running job 7569907 2024-02-21T20:53:50.169 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-02-21_20:42:01-fs-wip-yuri10-testing-2024-02-21-0731-reef-distro-default-smithi/7569907 --name yuriw-2024-02-21_20:42:01-fs-wip-yuri10-testing-2024-02-21-0731-reef-distro-default-smithi --description fs/upgrade/nofs/{bluestore-bitmap centos_latest conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-octopus 1-upgrade}} -- /home/teuthworker/archive/yuriw-2024-02-21_20:42:01-fs-wip-yuri10-testing-2024-02-21-0731-reef-distro-default-smithi/7569907/orig.config.yaml 2024-02-21T20:53:50.174 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2024-02-21_20:42:01-fs-wip-yuri10-testing-2024-02-21-0731-reef-distro-default-smithi/7569907 2024-02-21T20:53:50.174 INFO:teuthology.dispatcher.supervisor:Job PID: 1990805 2024-02-21T20:53:50.174 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-21T20:55:50.274 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T20:57:50.457 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T20:59:50.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:01:50.788 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:03:50.958 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:05:51.120 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:07:51.295 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:09:51.436 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:11:51.594 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:13:51.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:15:51.927 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-21T21:15:51.996 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1