2024-04-04T05:55:33.965 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-04T05:55:33.966 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T05:55:34.076 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2ece417c10>, signals=[15]) 2024-04-04T05:55:34.076 INFO:teuthology.lock.ops:Start node 'smithi042.front.sepia.ceph.com' reimaging 2024-04-04T05:55:34.076 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: reset os type and version on server 2024-04-04T05:55:34.077 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-04-04T05:55:34.215 DEBUG:teuthology.provision.fog.smithi042:Requesting image smithi_centos_9.stream (ID 10) 2024-04-04T05:55:34.266 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of centos 9.stream 2024-04-04T05:55:34.551 INFO:teuthology.orchestra.console.smithi042:Power off 2024-04-04T05:55:34.551 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-04T05:55:34.575 DEBUG:teuthology.orchestra.console.smithi042:power off output: Chassis Power Control: Down/Off 2024-04-04T05:55:34.575 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:34.598 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-04-04T05:55:38.602 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:38.712 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-04-04T05:55:42.714 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:42.824 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-04T05:55:42.925 INFO:teuthology.orchestra.console.smithi042:Power off completed 2024-04-04T05:55:43.026 INFO:teuthology.orchestra.console.smithi042:Power on 2024-04-04T05:55:43.026 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-04T05:55:43.046 DEBUG:teuthology.orchestra.console.smithi042:power on output: Chassis Power Control: Up/On 2024-04-04T05:55:43.046 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:43.069 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-04T05:55:47.071 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:47.180 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is off 2024-04-04T05:55:51.183 DEBUG:teuthology.orchestra.console.smithi042:pexpect command: ipmitool -H smithi042.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-04T05:55:51.292 DEBUG:teuthology.orchestra.console.smithi042:check power output: Chassis Power is on 2024-04-04T05:55:51.393 INFO:teuthology.orchestra.console.smithi042:Power on completed 2024-04-04T05:55:51.493 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish 2024-04-04T05:58:22.221 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:58:40.671 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-04T05:58:46.677 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:58:49.758 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-04T05:58:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T05:58:58.814 WARNING:teuthology.provision.fog.smithi042:[Errno None] Unable to connect to port 22 on 172.21.15.42 2024-04-04T05:59:04.821 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:00:04.883 WARNING:teuthology.provision.fog.smithi042:timed out 2024-04-04T06:00:10.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:00:11.211 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-04-04T06:00:11.212 DEBUG:teuthology.orchestra.run.smithi042:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-04-04T06:00:11.545 INFO:teuthology.provision.fog.smithi042:Node is ready 2024-04-04T06:00:11.545 DEBUG:teuthology.orchestra.run.smithi042:> hostname 2024-04-04T06:00:11.560 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com 2024-04-04T06:00:11.561 DEBUG:teuthology.orchestra.run.smithi042:> grep smithi042.front.sepia.ceph.com /etc/hosts 2024-04-04T06:00:11.616 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042 2024-04-04T06:00:11.616 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-04-04T06:00:11.727 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hosts 2024-04-04T06:00:11.759 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/172.21.15.42/172.21.15.42/g' /etc/hosts 2024-04-04T06:00:11.830 DEBUG:teuthology.orchestra.run.smithi042:> sudo sed -i -e 's/smithi042.front.sepia.ceph.com/smithi042/g' /etc/hostname 2024-04-04T06:00:11.901 DEBUG:teuthology.orchestra.run.smithi042:> sudo hostname smithi042 2024-04-04T06:00:11.971 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-04-04T06:00:12.026 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T06:00:12.027 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T06:00:12.028 INFO:teuthology.provision.fog.smithi042:Deploy complete! 2024-04-04T06:00:12.029 DEBUG:teuthology.parallel:result is None 2024-04-04T06:00:12.184 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com 2024-04-04T06:00:12.184 INFO:teuthology.lock.ops:New key found. Updating... 2024-04-04T06:00:12.209 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server 2024-04-04T06:00:12.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-04-04T06:00:12.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi042.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-04T06:00:12.314 DEBUG:teuthology.orchestra.run.smithi042:> true 2024-04-04T06:00:12.380 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi042.front.sepia.ceph.com' 2024-04-04T06:00:12.381 DEBUG:teuthology.orchestra.run.smithi042:> uname -m 2024-04-04T06:00:12.436 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64 2024-04-04T06:00:12.436 DEBUG:teuthology.orchestra.run.smithi042:> cat /etc/os-release 2024-04-04T06:00:12.490 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="CentOS Stream" 2024-04-04T06:00:12.490 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="9" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:ID="centos" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="rhel fedora" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="9" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el9" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:LOGO="fedora-logo-icon" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://centos.org/" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-04T06:00:12.491 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-04T06:00:12.492 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-04T06:00:12.492 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server 2024-04-04T06:00:12.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:00:12.586 INFO:teuthology.dispatcher.supervisor:Running job 7639286 2024-04-04T06:00:12.586 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2024-04-04_05:54:23-rados:encoder-main-distro-default-smithi/7639286 --name nmordech-2024-04-04_05:54:23-rados:encoder-main-distro-default-smithi --description rados:encoder/{0-random-distro$/{centos_9.stream} 0-start 1-tasks mon_election/classic workload/{}} -- /home/teuthworker/archive/nmordech-2024-04-04_05:54:23-rados:encoder-main-distro-default-smithi/7639286/orig.config.yaml 2024-04-04T06:00:12.589 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2024-04-04_05:54:23-rados:encoder-main-distro-default-smithi/7639286 2024-04-04T06:00:12.589 INFO:teuthology.dispatcher.supervisor:Job PID: 1308034 2024-04-04T06:00:12.589 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-04-04T06:02:12.667 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:04:12.835 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:06:13.001 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:08:13.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:10:13.343 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:12:13.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:14:13.682 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:16:13.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:18:14.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-04T06:18:14.111 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-04-04T06:18:14.174 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/vshankar-2024-04-04_05:15:36-fs-wip-vshankar-testing-20240330.172700-testing-default-smithi/7639229