2023-11-10T00:20:02.737 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2
2023-11-10T00:20:02.738 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:20:02.854 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f87a0e0ea60>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f87a1900670>, signals=[15])
2023-11-10T00:20:02.855 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging
2023-11-10T00:20:02.856 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server
2023-11-10T00:20:02.856 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-11-10T00:20:02.875 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /host {"name": "smithi107"}
2023-11-10T00:20:02.943 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /image {"name": "smithi_rhel_8.4"}
2023-11-10T00:20:02.987 DEBUG:teuthology.provision.fog.smithi107:Requesting image smithi_rhel_8.4 (ID 7)
2023-11-10T00:20:02.988 DEBUG:teuthology.provision.fog.smithi107:FOG request: PUT /host/212 {"imageID": 7}
2023-11-10T00:20:03.033 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of rhel 8.4
2023-11-10T00:20:03.034 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:20:03.092 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /tasktype {"name": "deploy"}
2023-11-10T00:20:03.127 DEBUG:teuthology.provision.fog.smithi107:FOG request: POST /host/212/task {"taskTypeID": 1}
2023-11-10T00:20:03.185 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:20:03.276 INFO:teuthology.orchestra.console.smithi107:Power off
2023-11-10T00:20:03.277 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T00:20:03.299 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2023-11-10T00:20:03.300 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T00:20:03.321 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2023-11-10T00:20:03.422 INFO:teuthology.orchestra.console.smithi107:Power off completed
2023-11-10T00:20:03.523 INFO:teuthology.orchestra.console.smithi107:Power on
2023-11-10T00:20:03.524 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2023-11-10T00:20:03.546 DEBUG:teuthology.orchestra.console.smithi107:power on output: Chassis Power Control: Up/On
2023-11-10T00:20:03.547 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T00:20:03.568 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2023-11-10T00:20:07.570 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T00:20:07.679 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2023-11-10T00:20:11.682 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T00:20:11.791 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is on
2023-11-10T00:20:11.892 INFO:teuthology.orchestra.console.smithi107:Power on completed
2023-11-10T00:20:11.993 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish
2023-11-10T00:20:11.994 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:20:27.070 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:20:42.143 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:20:57.214 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:21:12.286 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:21:27.358 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:21:42.426 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:21:57.503 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:22:12.586 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:22:27.665 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:22:42.758 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:22:57.835 DEBUG:teuthology.provision.fog.smithi107:FOG request: GET /task/active None
2023-11-10T00:22:57.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:00.958 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:06.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:10.042 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:16.046 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:19.098 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:25.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:28.154 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:34.158 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:37.210 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:43.214 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:46.266 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:23:52.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:23:55.326 WARNING:teuthology.provision.fog.smithi107:[Errno None] Unable to connect to port 22 on 172.21.15.107
2023-11-10T00:24:01.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:25:01.391 WARNING:teuthology.provision.fog.smithi107:timed out
2023-11-10T00:25:07.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:25:07.751 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-11-10T00:25:07.752 DEBUG:teuthology.orchestra.run.smithi107:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2023-11-10T00:25:08.037 INFO:teuthology.provision.fog.smithi107:Node is ready
2023-11-10T00:25:08.038 DEBUG:teuthology.orchestra.run.smithi107:> hostname
2023-11-10T00:25:08.091 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107
2023-11-10T00:25:08.091 DEBUG:teuthology.orchestra.run.smithi107:> grep smithi107 /etc/hosts
2023-11-10T00:25:08.149 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107
2023-11-10T00:25:08.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-11-10T00:25:08.267 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107/smithi107/g' /etc/hosts
2023-11-10T00:25:08.294 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/172.21.15.107/172.21.15.107/g' /etc/hosts
2023-11-10T00:25:08.361 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i -e 's/smithi107/smithi107/g' /etc/hostname
2023-11-10T00:25:08.424 DEBUG:teuthology.orchestra.run.smithi107:> sudo hostname smithi107
2023-11-10T00:25:08.487 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-11-10T00:25:08.542 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T00:25:08.542 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T00:25:08.542 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2023-11-10T00:25:08.543 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2023-11-10T00:25:08.543 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4"
2023-11-10T00:25:08.543 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2023-11-10T00:25:08.543 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T00:25:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-11-10T00:25:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T00:25:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T00:25:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T00:25:08.544 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T00:25:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:
2023-11-10T00:25:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T00:25:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T00:25:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T00:25:08.545 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T00:25:08.546 INFO:teuthology.provision.fog.smithi107:Deploy complete!
2023-11-10T00:25:08.548 DEBUG:teuthology.parallel:result is None
2023-11-10T00:25:08.655 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com
2023-11-10T00:25:08.656 INFO:teuthology.lock.ops:New key found. Updating...
2023-11-10T00:25:08.699 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server
2023-11-10T00:25:08.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com'
2023-11-10T00:25:08.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2023-11-10T00:25:08.765 DEBUG:teuthology.orchestra.run.smithi107:> true
2023-11-10T00:25:08.828 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com'
2023-11-10T00:25:08.829 DEBUG:teuthology.orchestra.run.smithi107:> uname -m
2023-11-10T00:25:08.880 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64
2023-11-10T00:25:08.881 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release
2023-11-10T00:25:08.933 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="Red Hat Enterprise Linux"
2023-11-10T00:25:08.933 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8.4 (Ootpa)"
2023-11-10T00:25:08.934 INFO:teuthology.orchestra.run.smithi107.stdout:ID="rhel"
2023-11-10T00:25:08.934 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="fedora"
2023-11-10T00:25:08.934 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8.4"
2023-11-10T00:25:08.934 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8"
2023-11-10T00:25:08.935 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-11-10T00:25:08.935 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31"
2023-11-10T00:25:08.935 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-11-10T00:25:08.935 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://www.redhat.com/"
2023-11-10T00:25:08.936 INFO:teuthology.orchestra.run.smithi107.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-11-10T00:25:08.936 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-11-10T00:25:08.936 INFO:teuthology.orchestra.run.smithi107.stdout:
2023-11-10T00:25:08.936 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-11-10T00:25:08.937 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-11-10T00:25:08.937 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-11-10T00:25:08.937 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-11-10T00:25:08.938 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server
2023-11-10T00:25:08.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:25:09.049 INFO:teuthology.dispatcher.supervisor:Running job 7453371
2023-11-10T00:25:09.050 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6899cd26fceddb2fec83dc1a1349394b28c8998e/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453371 --name yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi --description rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} -- /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453371/orig.config.yaml
2023-11-10T00:25:09.053 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453371
2023-11-10T00:25:09.054 INFO:teuthology.dispatcher.supervisor:Job PID: 1368982
2023-11-10T00:25:09.054 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-11-10T00:27:09.155 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:29:09.327 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:31:09.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:33:09.655 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:35:09.735 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:37:09.912 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:39:10.095 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:41:10.263 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:43:10.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:45:10.596 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:47:10.762 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:49:10.931 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2023-11-10T00:49:11.003 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120
2023-11-10T00:49:11.063 INFO:teuthology.dispatcher.supervisor:Nuking machines...
2023-11-10T00:49:11.064 INFO:teuthology.nuke:Checking targets against current locks
2023-11-10T00:49:11.108 DEBUG:teuthology.nuke:shortname: smithi107
2023-11-10T00:49:11.108 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-11-10T00:49:11.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-09_21:43:29-rados-wip-yuri4-testing-2023-11-09-0758-pacific-distro-default-smithi/7453371', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-10 00:20:01.966126', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5+UeQVkv/BMnTQRAhWX8hJSBWQyMOlYwZlNuJfz82VZ5QxkMZ1bbSJJyqbhqpJ6sG5y9TtRGtoglfb8+8nS+U='}
2023-11-10T00:49:11.186 INFO:teuthology.orchestra.console.smithi107:Power off
2023-11-10T00:49:11.186 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2023-11-10T00:49:11.210 DEBUG:teuthology.orchestra.console.smithi107:power off output: Chassis Power Control: Down/Off
2023-11-10T00:49:11.210 DEBUG:teuthology.orchestra.console.smithi107:pexpect command: ipmitool -H smithi107.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2023-11-10T00:49:11.231 DEBUG:teuthology.orchestra.console.smithi107:check power output: Chassis Power is off
2023-11-10T00:49:11.332 INFO:teuthology.orchestra.console.smithi107:Power off completed
2023-11-10T00:49:11.484 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com