2023-09-01T19:17:43.948 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-09-01T19:17:43.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:17:44.063 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0c24465670>, signals=[15]) 2023-09-01T19:17:44.065 INFO:teuthology.lock.ops:Start node 'smithi031.front.sepia.ceph.com' reimaging 2023-09-01T19:17:44.065 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: reset os type and version on server 2023-09-01T19:17:44.065 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-09-01T19:17:44.082 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /host {"name": "smithi031"} 2023-09-01T19:17:44.144 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /image {"name": "smithi_centos_8.stream"} 2023-09-01T19:17:44.194 DEBUG:teuthology.provision.fog.smithi031:Requesting image smithi_centos_8.stream (ID 3) 2023-09-01T19:17:44.194 DEBUG:teuthology.provision.fog.smithi031:FOG request: PUT /host/136 {"imageID": 3} 2023-09-01T19:17:44.252 INFO:teuthology.provision.fog.smithi031:Scheduling deploy of centos 8.stream 2023-09-01T19:17:44.252 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:17:44.381 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /tasktype {"name": "deploy"} 2023-09-01T19:17:44.412 DEBUG:teuthology.provision.fog.smithi031:FOG request: POST /host/136/task {"taskTypeID": 1} 2023-09-01T19:17:44.466 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:17:44.603 INFO:teuthology.orchestra.console.smithi031:Power off 2023-09-01T19:17:44.604 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T19:17:44.622 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-09-01T19:17:44.623 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:44.642 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T19:17:44.743 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-09-01T19:17:44.844 INFO:teuthology.orchestra.console.smithi031:Power on 2023-09-01T19:17:44.844 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-01T19:17:44.866 DEBUG:teuthology.orchestra.console.smithi031:power on output: Chassis Power Control: Up/On 2023-09-01T19:17:44.866 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:44.888 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T19:17:48.890 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:48.997 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T19:17:53.002 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:17:53.109 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-01T19:17:53.210 INFO:teuthology.orchestra.console.smithi031:Power on completed 2023-09-01T19:17:53.311 INFO:teuthology.provision.fog.smithi031:Waiting for deploy to finish 2023-09-01T19:17:53.311 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:18:08.562 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:18:23.825 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:18:39.077 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:18:54.363 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:19:09.618 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:19:24.958 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:19:40.329 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:19:56.082 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:20:11.625 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:20:32.694 DEBUG:teuthology.provision.fog.smithi031:FOG request: GET /task/active None 2023-09-01T19:20:39.624 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:20:42.682 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T19:20:48.690 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:20:51.770 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T19:20:57.777 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:21:00.858 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T19:21:06.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:21:09.914 WARNING:teuthology.provision.fog.smithi031:[Errno None] Unable to connect to port 22 on 172.21.15.31 2023-09-01T19:21:15.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:22:15.924 WARNING:teuthology.provision.fog.smithi031:timed out 2023-09-01T19:22:21.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:22:22.224 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-09-01T19:22:22.225 DEBUG:teuthology.orchestra.run.smithi031:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2023-09-01T19:22:22.476 INFO:teuthology.provision.fog.smithi031:Node is ready 2023-09-01T19:22:22.476 DEBUG:teuthology.orchestra.run.smithi031:> hostname 2023-09-01T19:22:22.496 INFO:teuthology.orchestra.run.smithi031.stdout:smithi031.front.sepia.ceph.com 2023-09-01T19:22:22.497 DEBUG:teuthology.orchestra.run.smithi031:> grep smithi031.front.sepia.ceph.com /etc/hosts 2023-09-01T19:22:22.558 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31 smithi031.front.sepia.ceph.com smithi031 2023-09-01T19:22:22.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-09-01T19:22:22.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hosts 2023-09-01T19:22:22.696 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/172.21.15.31/172.21.15.31/g' /etc/hosts 2023-09-01T19:22:22.768 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i -e 's/smithi031.front.sepia.ceph.com/smithi031/g' /etc/hostname 2023-09-01T19:22:22.841 DEBUG:teuthology.orchestra.run.smithi031:> sudo hostname smithi031 2023-09-01T19:22:22.912 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-09-01T19:22:22.972 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-09-01T19:22:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8" 2023-09-01T19:22:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-09-01T19:22:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-09-01T19:22:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2023-09-01T19:22:22.973 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-09-01T19:22:22.974 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-01T19:22:22.974 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-09-01T19:22:22.974 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-01T19:22:22.974 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-09-01T19:22:22.974 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T19:22:22.975 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-01T19:22:22.975 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-01T19:22:22.975 INFO:teuthology.provision.fog.smithi031:Deploy complete! 2023-09-01T19:22:22.992 DEBUG:teuthology.parallel:result is None 2023-09-01T19:22:23.137 INFO:teuthology.lock.ops:Checking smithi031.front.sepia.ceph.com 2023-09-01T19:22:23.138 INFO:teuthology.lock.ops:New key found. Updating... 2023-09-01T19:22:23.160 INFO:teuthology.lock.ops:Updating [smithi031.front.sepia.ceph.com]: set os type and version on server 2023-09-01T19:22:23.160 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-09-01T19:22:23.161 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-01T19:22:23.228 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-09-01T19:22:23.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-09-01T19:22:23.257 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-09-01T19:22:23.317 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-09-01T19:22:23.317 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-09-01T19:22:23.377 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="CentOS Stream" 2023-09-01T19:22:23.377 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8" 2023-09-01T19:22:23.378 INFO:teuthology.orchestra.run.smithi031.stdout:ID="centos" 2023-09-01T19:22:23.378 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="rhel fedora" 2023-09-01T19:22:23.378 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8" 2023-09-01T19:22:23.378 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-09-01T19:22:23.378 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="CentOS Stream 8" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://centos.org/" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-01T19:22:23.379 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-09-01T19:22:23.380 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-09-01T19:22:23.400 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:22:23.484 INFO:teuthology.dispatcher.supervisor:Running job 7386230 2023-09-01T19:22:23.485 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386230 --name yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi --description rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} -- /home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386230/orig.config.yaml 2023-09-01T19:22:23.487 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386230 2023-09-01T19:22:23.488 INFO:teuthology.dispatcher.supervisor:Job PID: 471760 2023-09-01T19:22:23.488 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-09-01T19:24:23.493 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:26:23.651 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:28:23.819 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:30:24.107 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:32:24.340 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:34:24.549 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:36:25.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:38:25.492 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:40:25.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:42:25.935 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:44:26.103 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:46:26.255 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:48:26.414 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:50:26.591 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:52:26.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:54:26.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-01T19:54:26.990 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-09-01T19:54:27.048 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-09-01T19:54:27.048 INFO:teuthology.nuke:Checking targets against current locks 2023-09-01T19:54:27.094 DEBUG:teuthology.nuke:shortname: smithi031 2023-09-01T19:54:27.094 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-01T19:54:27.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-01_19:14:47-rados-wip-batrick-testing-20230831.124848-pacific-distro-default-smithi/7386230', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-01 19:17:43.232628', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDY3t+9Adp5TyZYhe/hbxq0Zof0PqWDYgYW6kWASfqKGPmgUGfqWIBiWY4HwSPCARgyM4ov4tkTE6095Su6qfXnY2gesvb5gkEkm5G5pHZAcJAdXfuSMiUVAP/VX4Or7AsODVOer+qzQo3TQh6fSKUdqDiQYPGKiEmKz2i6qErKROBs6M+U6l8D45CbtU8Funr/Jjvn8sd8HuYFIBKqQNPoyCljhUf9K+qNAlTRkOd+E75KlQ2piYbaO6KJyC4FB/wQjB5HuW+HstyAqj3SMIUwhAqIkSFeLEqNptiDnw4Ynv2qDDT/0PBFRlzm9JC2WlfLSKU6mHzY6LdAeKmsVXJ9zM5If+aIdc/oVTPWR0gLmVwE6yrdFTUmRP9GlkbJS/65oJO3ZK+ZXRobkQSHOxY04nsOgGrKzF+SUfUhKSrJ4xLLeq2g+m0MeFJFwGFIlDrNMrWUun4SXhjI0/MqUQwffjy6WVc0qt24TOXCicdm7A4J1Wi9p1R9qWPraA8ahcE='} 2023-09-01T19:54:27.162 INFO:teuthology.orchestra.console.smithi031:Power off 2023-09-01T19:54:27.163 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-01T19:54:27.184 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-09-01T19:54:27.184 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-01T19:54:27.205 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-01T19:54:27.306 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-09-01T19:54:27.456 INFO:teuthology.lock.ops:unlocked: smithi031.front.sepia.ceph.com