2024-02-20T13:23:50.652 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-20T13:23:50.652 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:23:50.763 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f85e5f3ac10>, signals=[15]) 2024-02-20T13:23:50.763 INFO:teuthology.lock.ops:Start node 'smithi078.front.sepia.ceph.com' reimaging 2024-02-20T13:23:50.764 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: reset os type and version on server 2024-02-20T13:23:50.764 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-02-20T13:23:50.898 DEBUG:teuthology.provision.fog.smithi078:Requesting image smithi_centos_9.stream (ID 10) 2024-02-20T13:23:50.948 INFO:teuthology.provision.fog.smithi078:Scheduling deploy of centos 9.stream 2024-02-20T13:23:51.215 INFO:teuthology.orchestra.console.smithi078:Power off 2024-02-20T13:23:51.215 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-20T13:23:51.238 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2024-02-20T13:23:51.238 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:23:51.260 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-02-20T13:23:55.264 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:23:55.373 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-02-20T13:23:59.376 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:23:59.484 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-02-20T13:24:03.488 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:24:03.597 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-02-20T13:24:03.698 INFO:teuthology.orchestra.console.smithi078:Power off completed 2024-02-20T13:24:03.798 INFO:teuthology.orchestra.console.smithi078:Power on 2024-02-20T13:24:03.799 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-02-20T13:24:03.823 DEBUG:teuthology.orchestra.console.smithi078:power on output: Chassis Power Control: Up/On 2024-02-20T13:24:03.824 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:24:03.845 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-02-20T13:24:07.848 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:24:07.957 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2024-02-20T13:24:11.960 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-20T13:24:12.068 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2024-02-20T13:24:12.169 INFO:teuthology.orchestra.console.smithi078:Power on completed 2024-02-20T13:24:12.269 INFO:teuthology.provision.fog.smithi078:Waiting for deploy to finish 2024-02-20T13:26:43.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:26:46.208 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:26:52.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:26:55.295 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:01.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:27:04.380 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:10.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:27:13.468 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:19.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:27:22.528 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:28.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:27:31.612 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:37.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:27:40.700 WARNING:teuthology.provision.fog.smithi078:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-02-20T13:27:46.706 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:28:46.765 WARNING:teuthology.provision.fog.smithi078:timed out 2024-02-20T13:28:52.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:28:53.254 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-02-20T13:28:53.254 DEBUG:teuthology.orchestra.run.smithi078:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-02-20T13:28:53.570 INFO:teuthology.provision.fog.smithi078:Node is ready 2024-02-20T13:28:53.570 DEBUG:teuthology.orchestra.run.smithi078:> hostname 2024-02-20T13:28:53.584 INFO:teuthology.orchestra.run.smithi078.stdout:smithi078.front.sepia.ceph.com 2024-02-20T13:28:53.584 DEBUG:teuthology.orchestra.run.smithi078:> grep smithi078.front.sepia.ceph.com /etc/hosts 2024-02-20T13:28:53.639 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.15.78 smithi078.front.sepia.ceph.com smithi078 2024-02-20T13:28:53.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2024-02-20T13:28:53.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hosts 2024-02-20T13:28:53.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/172.21.15.78/172.21.15.78/g' /etc/hosts 2024-02-20T13:28:53.842 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i -e 's/smithi078.front.sepia.ceph.com/smithi078/g' /etc/hostname 2024-02-20T13:28:53.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo hostname smithi078 2024-02-20T13:28:53.976 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-02-20T13:28:54.030 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-02-20T13:28:54.030 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-02-20T13:28:54.030 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T13:28:54.031 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T13:28:54.032 INFO:teuthology.provision.fog.smithi078:Deploy complete! 2024-02-20T13:28:54.033 DEBUG:teuthology.parallel:result is None 2024-02-20T13:28:54.163 INFO:teuthology.lock.ops:Checking smithi078.front.sepia.ceph.com 2024-02-20T13:28:54.164 INFO:teuthology.lock.ops:New key found. Updating... 2024-02-20T13:28:54.189 INFO:teuthology.lock.ops:Updating [smithi078.front.sepia.ceph.com]: set os type and version on server 2024-02-20T13:28:54.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-02-20T13:28:54.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-20T13:28:54.279 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-02-20T13:28:54.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-02-20T13:28:54.346 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-02-20T13:28:54.400 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-02-20T13:28:54.400 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="CentOS Stream" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="9" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:ID="centos" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE="rhel fedora" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="9" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM_ID="platform:el9" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:ANSI_COLOR="0;31" 2024-02-20T13:28:54.455 INFO:teuthology.orchestra.run.smithi078.stdout:LOGO="fedora-logo-icon" 2024-02-20T13:28:54.456 INFO:teuthology.orchestra.run.smithi078.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-20T13:28:54.456 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://centos.org/" 2024-02-20T13:28:54.456 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-20T13:28:54.456 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-20T13:28:54.456 INFO:teuthology.orchestra.run.smithi078.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-20T13:28:54.456 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-02-20T13:28:54.479 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:28:54.571 INFO:teuthology.dispatcher.supervisor:Running job 7568684 2024-02-20T13:28:54.571 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-20_13:19:57-fs:mirror-wip-jcollin-testing_20Feb2024-distro-default-smithi/7568684 --name jcollin-2024-02-20_13:19:57-fs:mirror-wip-jcollin-testing_20Feb2024-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-20_13:19:57-fs:mirror-wip-jcollin-testing_20Feb2024-distro-default-smithi/7568684/orig.config.yaml 2024-02-20T13:28:54.573 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-20_13:19:57-fs:mirror-wip-jcollin-testing_20Feb2024-distro-default-smithi/7568684 2024-02-20T13:28:54.574 INFO:teuthology.dispatcher.supervisor:Job PID: 374476 2024-02-20T13:28:54.574 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-02-20T13:30:54.666 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:32:54.844 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:34:55.015 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:36:55.202 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:38:55.369 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-20T13:38:55.427 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-02-20T13:38:55.587 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi078 but it was locked by another job: /home/teuthworker/archive/yuriw-2024-02-19_20:24:58-rados-wip-yuri5-testing-2024-02-16-1120-quincy-distro-default-smithi/7567756