2024-01-29T18:47:32.873 INFO:root:teuthology version: 0.0.1.dev251+gc856e0f 2024-01-29T18:47:32.874 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T18:47:32.981 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a94b24c10>, signals=[15]) 2024-01-29T18:47:32.981 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2024-01-29T18:47:32.982 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2024-01-29T18:47:32.982 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-29T18:47:33.118 DEBUG:teuthology.provision.fog.smithi152:Requesting image smithi_centos_8.stream (ID 3) 2024-01-29T18:47:33.172 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2024-01-29T18:47:33.425 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-29T18:47:33.425 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-29T18:47:33.449 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-29T18:47:33.449 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:33.474 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-29T18:47:37.476 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:37.584 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-29T18:47:41.588 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:41.700 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-29T18:47:45.704 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:45.813 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-29T18:47:45.914 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-29T18:47:46.014 INFO:teuthology.orchestra.console.smithi152:Power on 2024-01-29T18:47:46.015 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-01-29T18:47:46.036 DEBUG:teuthology.orchestra.console.smithi152:power on output: Chassis Power Control: Up/On 2024-01-29T18:47:46.036 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:46.057 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-29T18:47:50.060 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T18:47:50.169 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-01-29T18:47:50.269 INFO:teuthology.orchestra.console.smithi152:Power on completed 2024-01-29T18:47:50.370 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2024-01-29T18:50:36.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:50:54.652 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:00.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:51:03.712 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:09.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:51:12.796 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:18.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:51:21.856 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:27.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:51:30.940 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:36.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:51:39.996 WARNING:teuthology.provision.fog.smithi152:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-01-29T18:51:46.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:52:46.061 WARNING:teuthology.provision.fog.smithi152:timed out 2024-01-29T18:52:52.067 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:52:52.314 INFO:teuthology.orchestra.run:Running command with timeout 600 2024-01-29T18:52:52.315 DEBUG:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2024-01-29T18:52:52.571 INFO:teuthology.provision.fog.smithi152:Node is ready 2024-01-29T18:52:52.572 DEBUG:teuthology.orchestra.run.smithi152:> hostname 2024-01-29T18:52:52.591 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2024-01-29T18:52:52.592 DEBUG:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2024-01-29T18:52:52.650 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2024-01-29T18:52:52.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-29T18:52:52.751 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2024-01-29T18:52:52.780 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2024-01-29T18:52:52.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2024-01-29T18:52:52.917 DEBUG:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2024-01-29T18:52:52.984 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-29T18:52:53.042 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-01-29T18:52:53.042 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-01-29T18:52:53.042 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-01-29T18:52:53.042 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-01-29T18:52:53.042 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-29T18:52:53.043 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-29T18:52:53.044 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2024-01-29T18:52:53.045 DEBUG:teuthology.parallel:result is None 2024-01-29T18:52:53.156 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2024-01-29T18:52:53.156 INFO:teuthology.lock.ops:New key found. Updating... 2024-01-29T18:52:53.189 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2024-01-29T18:52:53.189 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-29T18:52:53.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-29T18:52:53.261 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-01-29T18:52:53.330 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-01-29T18:52:53.330 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-01-29T18:52:53.388 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-01-29T18:52:53.388 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2024-01-29T18:52:53.446 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-01-29T18:52:53.447 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-29T18:52:53.447 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-01-29T18:52:53.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T18:52:53.563 INFO:teuthology.dispatcher.supervisor:Running job 7537284 2024-01-29T18:52:53.563 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_c856e0f9244dd29a50697123b480d63f16a4ed81/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2024-01-29_16:26:06-rados-wip-lflores-testing-2024-01-29-0542-distro-default-smithi/7537284 --name lflores-2024-01-29_16:26:06-rados-wip-lflores-testing-2024-01-29-0542-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_timeout} -- /home/teuthworker/archive/lflores-2024-01-29_16:26:06-rados-wip-lflores-testing-2024-01-29-0542-distro-default-smithi/7537284/orig.config.yaml 2024-01-29T18:52:53.568 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2024-01-29_16:26:06-rados-wip-lflores-testing-2024-01-29-0542-distro-default-smithi/7537284 2024-01-29T18:52:53.568 INFO:teuthology.dispatcher.supervisor:Job PID: 3905968 2024-01-29T18:52:53.569 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2024-01-29T18:54:53.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T18:56:53.848 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T18:58:54.023 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:00:54.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:02:54.395 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:04:54.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:06:54.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:08:54.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:10:55.031 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:12:55.199 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:14:55.373 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:16:55.543 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:18:55.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-29T19:18:55.787 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2024-01-29T19:18:55.848 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2024-01-29T19:18:55.849 INFO:teuthology.nuke:Checking targets against current locks 2024-01-29T19:18:55.894 DEBUG:teuthology.nuke:shortname: smithi152 2024-01-29T19:18:55.894 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-29T19:18:55.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/lflores-2024-01-29_16:26:06-rados-wip-lflores-testing-2024-01-29-0542-distro-default-smithi/7537284', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-29 18:47:31.897330', 'locked_by': 'scheduled_lflores@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBARA+GVIg1sw4d/+l+gT+p3Ye0NaXi0kJN91H/0LzhjY6dF5VyCeKVgTkqDgDT7RnbeV5F7IprfFtS+MSsISsFE='} 2024-01-29T19:18:55.966 INFO:teuthology.orchestra.console.smithi152:Power off 2024-01-29T19:18:55.967 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-29T19:18:55.989 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-01-29T19:18:55.990 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-29T19:18:56.009 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-01-29T19:18:56.110 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-01-29T19:18:56.261 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com