2023-06-12T20:23:03.454 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-12T20:23:03.622 INFO:teuthology.lock.ops:Start node 'smithi101.front.sepia.ceph.com' reimaging 2023-06-12T20:23:03.623 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: reset os type and version on server 2023-06-12T20:23:03.624 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-12T20:23:03.645 INFO:teuthology.lock.ops:Start node 'smithi184.front.sepia.ceph.com' reimaging 2023-06-12T20:23:03.645 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: reset os type and version on server 2023-06-12T20:23:03.646 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-12T20:23:03.815 INFO:teuthology.provision.fog.smithi101:Scheduling deploy of rhel 8.4 2023-06-12T20:23:03.833 INFO:teuthology.provision.fog.smithi184:Scheduling deploy of rhel 8.4 2023-06-12T20:23:04.153 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-12T20:23:04.171 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-12T20:23:04.305 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-06-12T20:23:04.315 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-12T20:23:04.406 INFO:teuthology.orchestra.console:Power on smithi184 2023-06-12T20:23:04.417 INFO:teuthology.orchestra.console:Power on smithi101 2023-06-12T20:23:12.777 INFO:teuthology.orchestra.console:Power on for smithi184 completed 2023-06-12T20:23:12.788 INFO:teuthology.orchestra.console:Power on for smithi101 completed 2023-06-12T20:23:12.879 INFO:teuthology.provision.fog.smithi184:Waiting for deploy to finish 2023-06-12T20:23:12.889 INFO:teuthology.provision.fog.smithi101:Waiting for deploy to finish 2023-06-12T20:26:17.424 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:26:17.425 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:26:26.484 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:26:26.485 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:26:35.568 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:26:35.569 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:26:44.624 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:26:44.625 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:26:53.684 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:26:53.685 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:27:02.771 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:27:02.772 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:27:19.028 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:27:27.216 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:27:28.112 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:27:36.272 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:27:37.168 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.101 2023-06-12T20:27:45.282 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-12T20:27:45.332 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.184 2023-06-12T20:27:51.893 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-12T20:28:06.010 INFO:teuthology.provision.fog.smithi101:Node is ready 2023-06-12T20:28:06.027 INFO:teuthology.orchestra.run.smithi101.stdout:smithi036 2023-06-12T20:28:06.082 INFO:teuthology.orchestra.run.smithi101.stdout:172.21.15.36 smithi036.front.sepia.ceph.com smithi036 2023-06-12T20:28:06.481 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-06-12T20:28:06.481 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.4 (Ootpa)" 2023-06-12T20:28:06.481 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-06-12T20:28:06.481 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.4" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-12T20:28:06.482 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-12T20:28:06.483 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-12T20:28:06.484 INFO:teuthology.provision.fog.smithi101:Deploy complete! 2023-06-12T20:28:08.131 INFO:teuthology.provision.fog.smithi184:Node is ready 2023-06-12T20:28:08.146 INFO:teuthology.orchestra.run.smithi184.stdout:smithi184.front.sepia.ceph.com 2023-06-12T20:28:08.201 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.15.184 smithi184.front.sepia.ceph.com smithi184 2023-06-12T20:28:08.623 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-06-12T20:28:08.623 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.4 (Ootpa)" 2023-06-12T20:28:08.623 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-06-12T20:28:08.623 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.4" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-06-12T20:28:08.624 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-12T20:28:08.625 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-12T20:28:08.625 INFO:teuthology.provision.fog.smithi184:Deploy complete! 2023-06-12T20:28:08.820 INFO:teuthology.lock.ops:Checking smithi101.front.sepia.ceph.com 2023-06-12T20:28:08.821 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-12T20:28:08.846 INFO:teuthology.lock.ops:Checking smithi184.front.sepia.ceph.com 2023-06-12T20:28:08.846 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-12T20:28:08.871 INFO:teuthology.lock.ops:Updating [smithi101.front.sepia.ceph.com]: set os type and version on server 2023-06-12T20:28:08.872 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi101.front.sepia.ceph.com' 2023-06-12T20:28:09.058 INFO:teuthology.orchestra.run.smithi101.stdout:x86_64 2023-06-12T20:28:09.112 INFO:teuthology.orchestra.run.smithi101.stdout:NAME="Red Hat Enterprise Linux" 2023-06-12T20:28:09.113 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION="8.4 (Ootpa)" 2023-06-12T20:28:09.113 INFO:teuthology.orchestra.run.smithi101.stdout:ID="rhel" 2023-06-12T20:28:09.113 INFO:teuthology.orchestra.run.smithi101.stdout:ID_LIKE="fedora" 2023-06-12T20:28:09.114 INFO:teuthology.orchestra.run.smithi101.stdout:VERSION_ID="8.4" 2023-06-12T20:28:09.114 INFO:teuthology.orchestra.run.smithi101.stdout:PLATFORM_ID="platform:el8" 2023-06-12T20:28:09.114 INFO:teuthology.orchestra.run.smithi101.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-12T20:28:09.114 INFO:teuthology.orchestra.run.smithi101.stdout:ANSI_COLOR="0;31" 2023-06-12T20:28:09.115 INFO:teuthology.orchestra.run.smithi101.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-12T20:28:09.116 INFO:teuthology.orchestra.run.smithi101.stdout:HOME_URL="https://www.redhat.com/" 2023-06-12T20:28:09.116 INFO:teuthology.orchestra.run.smithi101.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-12T20:28:09.116 INFO:teuthology.orchestra.run.smithi101.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-12T20:28:09.117 INFO:teuthology.orchestra.run.smithi101.stdout: 2023-06-12T20:28:09.117 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-12T20:28:09.117 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-12T20:28:09.117 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-12T20:28:09.118 INFO:teuthology.orchestra.run.smithi101.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-12T20:28:09.118 INFO:teuthology.lock.ops:Updating smithi101.front.sepia.ceph.com on lock server 2023-06-12T20:28:09.146 INFO:teuthology.lock.ops:Updating [smithi184.front.sepia.ceph.com]: set os type and version on server 2023-06-12T20:28:09.146 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2023-06-12T20:28:09.333 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2023-06-12T20:28:09.387 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="Red Hat Enterprise Linux" 2023-06-12T20:28:09.387 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="8.4 (Ootpa)" 2023-06-12T20:28:09.387 INFO:teuthology.orchestra.run.smithi184.stdout:ID="rhel" 2023-06-12T20:28:09.387 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="fedora" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="8.4" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el8" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-12T20:28:09.388 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://www.redhat.com/" 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout: 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-12T20:28:09.389 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-12T20:28:09.390 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2023-06-12T20:28:09.536 INFO:teuthology.dispatcher.supervisor:Running job 7301584 2023-06-12T20:28:09.536 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-12_19:21:42-fs-wip-yuri4-testing-2023-06-12-0753-quincy-distro-default-smithi/7301584 --name yuriw-2023-06-12_19:21:42-fs-wip-yuri4-testing-2023-06-12-0753-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/client-readahead} -- /home/teuthworker/archive/yuriw-2023-06-12_19:21:42-fs-wip-yuri4-testing-2023-06-12-0753-quincy-distro-default-smithi/7301584/orig.config.yaml 2023-06-12T20:28:09.539 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-12_19:21:42-fs-wip-yuri4-testing-2023-06-12-0753-quincy-distro-default-smithi/7301584 2023-06-12T20:28:09.541 INFO:teuthology.dispatcher.supervisor:Job PID: 13889 2023-06-12T20:28:09.541 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-12T20:48:11.321 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-12T20:48:11.438 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-12T20:48:11.438 INFO:teuthology.nuke:Checking targets against current locks 2023-06-12T20:48:11.487 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-12T20:48:11.518 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-12T20:48:11.551 INFO:teuthology.orchestra.console:Power off smithi101 2023-06-12T20:48:11.618 INFO:teuthology.orchestra.console:Power off smithi184 2023-06-12T20:48:11.700 INFO:teuthology.orchestra.console:Power off for smithi101 completed 2023-06-12T20:48:11.769 INFO:teuthology.orchestra.console:Power off for smithi184 completed 2023-06-12T20:48:11.854 INFO:teuthology.lock.ops:unlocked: smithi101.front.sepia.ceph.com 2023-06-12T20:48:11.921 INFO:teuthology.lock.ops:unlocked: smithi184.front.sepia.ceph.com