2023-09-30T00:05:22.844 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T00:05:22.845 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:05:22.971 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f52043d5670>, signals=[15]) 2023-09-30T00:05:22.972 INFO:teuthology.lock.ops:Start node 'smithi064.front.sepia.ceph.com' reimaging 2023-09-30T00:05:22.972 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: reset os type and version on server 2023-09-30T00:05:22.972 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-09-30T00:05:22.997 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /host {"name": "smithi064"} 2023-09-30T00:05:23.074 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-30T00:05:23.129 DEBUG:teuthology.provision.fog.smithi064:Requesting image smithi_centos_8.stream (ID 3) 2023-09-30T00:05:23.129 DEBUG:teuthology.provision.fog.smithi064:FOG request: PUT /host/169 {"imageID": 3} 2023-09-30T00:05:23.182 INFO:teuthology.provision.fog.smithi064:Scheduling deploy of centos 8.stream 2023-09-30T00:05:23.182 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:05:23.241 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /tasktype {"name": "deploy"} 2023-09-30T00:05:23.285 DEBUG:teuthology.provision.fog.smithi064:FOG request: POST /host/169/task {"taskTypeID": 1} 2023-09-30T00:05:23.346 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:05:23.445 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-30T00:05:23.446 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T00:05:23.468 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-30T00:05:23.468 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:05:23.491 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-30T00:05:23.591 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-30T00:05:23.692 INFO:teuthology.orchestra.console.smithi064:Power on 2023-09-30T00:05:23.692 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T00:05:23.713 DEBUG:teuthology.orchestra.console.smithi064:power on output: Chassis Power Control: Up/On 2023-09-30T00:05:23.714 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:05:23.734 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-30T00:05:27.738 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:05:27.846 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-09-30T00:05:27.947 INFO:teuthology.orchestra.console.smithi064:Power on completed 2023-09-30T00:05:28.047 INFO:teuthology.provision.fog.smithi064:Waiting for deploy to finish 2023-09-30T00:05:28.048 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:05:43.142 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:05:58.230 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:06:13.318 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:06:28.402 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:06:43.493 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:06:58.572 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:07:13.651 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:07:28.722 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:07:43.794 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:07:58.878 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:08:13.949 DEBUG:teuthology.provision.fog.smithi064:FOG request: GET /task/active None 2023-09-30T00:08:14.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:08:32.378 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-30T00:08:38.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:08:41.434 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-30T00:08:47.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:08:50.522 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-30T00:08:56.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:08:59.578 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-30T00:09:05.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:09:08.635 WARNING:teuthology.provision.fog.smithi064:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-09-30T00:09:14.641 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:10:14.681 WARNING:teuthology.provision.fog.smithi064:timed out 2023-09-30T00:10:20.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:10:20.899 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-30T00:10:20.900 DEBUG:teuthology.orchestra.run.smithi064:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-30T00:10:21.141 INFO:teuthology.provision.fog.smithi064:Node is ready 2023-09-30T00:10:21.142 DEBUG:teuthology.orchestra.run.smithi064:> hostname 2023-09-30T00:10:21.202 INFO:teuthology.orchestra.run.smithi064.stdout:smithi064.front.sepia.ceph.com 2023-09-30T00:10:21.202 DEBUG:teuthology.orchestra.run.smithi064:> grep smithi064.front.sepia.ceph.com /etc/hosts 2023-09-30T00:10:21.261 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.15.64 smithi064.front.sepia.ceph.com smithi064 2023-09-30T00:10:21.262 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-30T00:10:21.361 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hosts 2023-09-30T00:10:21.390 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/172.21.15.64/172.21.15.64/g' /etc/hosts 2023-09-30T00:10:21.459 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i -e 's/smithi064.front.sepia.ceph.com/smithi064/g' /etc/hostname 2023-09-30T00:10:21.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo hostname smithi064 2023-09-30T00:10:21.596 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-09-30T00:10:21.654 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-09-30T00:10:21.654 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-09-30T00:10:21.655 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T00:10:21.656 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T00:10:21.656 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T00:10:21.656 INFO:teuthology.provision.fog.smithi064:Deploy complete! 2023-09-30T00:10:21.658 DEBUG:teuthology.parallel:result is None 2023-09-30T00:10:21.768 INFO:teuthology.lock.ops:Checking smithi064.front.sepia.ceph.com 2023-09-30T00:10:21.768 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-30T00:10:21.788 INFO:teuthology.lock.ops:Updating [smithi064.front.sepia.ceph.com]: set os type and version on server 2023-09-30T00:10:21.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-09-30T00:10:21.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T00:10:21.853 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-09-30T00:10:21.919 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-09-30T00:10:21.920 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-09-30T00:10:21.978 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-09-30T00:10:21.978 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-09-30T00:10:22.035 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-09-30T00:10:22.035 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T00:10:22.036 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-30T00:10:22.037 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-09-30T00:10:22.053 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:10:22.136 INFO:teuthology.dispatcher.supervisor:Running job 7406707 2023-09-30T00:10:22.136 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406707 --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --description rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406707/orig.config.yaml 2023-09-30T00:10:22.139 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406707 2023-09-30T00:10:22.139 INFO:teuthology.dispatcher.supervisor:Job PID: 2689221 2023-09-30T00:10:22.139 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-30T00:12:22.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:14:22.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:16:22.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:18:22.759 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:20:22.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:22:23.096 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:24:23.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:26:23.431 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:28:23.603 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:30:23.791 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:32:23.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:34:24.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:36:24.323 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:38:24.487 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:40:24.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:42:24.820 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:44:24.987 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:46:25.151 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:48:25.463 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T00:48:25.529 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1 2023-09-30T00:48:25.589 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-30T00:48:25.589 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T00:48:25.634 DEBUG:teuthology.nuke:shortname: smithi064 2023-09-30T00:48:25.634 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T00:48:25.655 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7406707', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 00:05:22.097388', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMtUjijGq4MdbVbi0ByB6xWj8SzW+17H02vu2gqjCEYQySdfGQ521zukTm3SPUe7opgCoSVqwvxY5uYcvay8Qvg='} 2023-09-30T00:48:25.704 INFO:teuthology.orchestra.console.smithi064:Power off 2023-09-30T00:48:25.704 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T00:48:25.725 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-09-30T00:48:25.726 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T00:48:25.746 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-09-30T00:48:25.847 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-09-30T00:48:25.995 INFO:teuthology.lock.ops:unlocked: smithi064.front.sepia.ceph.com