2023-06-08T22:45:38.594 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-08T22:45:38.764 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2023-06-08T22:45:38.766 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T22:45:38.766 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-08T22:45:38.796 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-06-08T22:45:38.797 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-06-08T22:45:38.797 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-08T22:45:38.969 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.4 2023-06-08T22:45:38.980 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of rhel 8.4 2023-06-08T22:45:39.224 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-08T22:45:39.242 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-08T22:45:39.374 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-08T22:45:39.387 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-08T22:45:39.476 INFO:teuthology.orchestra.console:Power on smithi149 2023-06-08T22:45:39.489 INFO:teuthology.orchestra.console:Power on smithi123 2023-06-08T22:45:47.851 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-06-08T22:45:47.859 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2023-06-08T22:45:47.953 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-06-08T22:45:47.960 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2023-06-08T22:48:37.072 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:48:37.073 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:48:46.128 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:48:46.129 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:48:55.184 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:48:55.185 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:49:04.240 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:49:04.244 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:49:13.296 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:49:13.300 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:49:22.356 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:49:22.384 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.123 2023-06-08T22:49:31.440 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:49:40.496 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-06-08T22:50:28.427 WARNING:teuthology.provision.fog:timed out 2023-06-08T22:50:34.763 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T22:50:35.055 INFO:teuthology.provision.fog.smithi123:Node is ready 2023-06-08T22:50:35.115 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2023-06-08T22:50:35.176 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2023-06-08T22:50:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T22:50:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)" 2023-06-08T22:50:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-06-08T22:50:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-06-08T22:50:35.584 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T22:50:35.585 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T22:50:35.586 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-06-08T22:50:35.586 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T22:50:35.586 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-08T22:50:35.586 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T22:50:35.586 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-08T22:50:35.587 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2023-06-08T22:50:46.512 WARNING:teuthology.provision.fog:timed out 2023-06-08T22:50:52.948 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-08T22:50:53.222 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-06-08T22:50:53.241 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149 2023-06-08T22:50:53.296 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-06-08T22:50:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T22:50:53.694 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.4 (Ootpa)" 2023-06-08T22:50:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-06-08T22:50:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-06-08T22:50:53.695 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.4" 2023-06-08T22:50:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-06-08T22:50:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-08T22:50:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-06-08T22:50:53.696 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-08T22:50:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T22:50:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T22:50:53.697 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T22:50:53.698 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-08T22:50:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T22:50:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-08T22:50:53.698 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T22:50:53.699 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-08T22:50:53.699 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-06-08T22:50:53.850 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2023-06-08T22:50:53.851 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T22:50:53.875 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-06-08T22:50:53.875 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-08T22:50:53.901 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2023-06-08T22:50:53.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2023-06-08T22:50:54.132 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2023-06-08T22:50:54.186 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-08T22:50:54.187 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout: 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T22:50:54.188 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-08T22:50:54.189 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T22:50:54.189 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-08T22:50:54.189 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2023-06-08T22:50:54.208 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-06-08T22:50:54.208 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-06-08T22:50:54.395 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-06-08T22:50:54.451 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Red Hat Enterprise Linux" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="8.4 (Ootpa)" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:ID="rhel" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE="fedora" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="8.4" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:PLATFORM_ID="platform:el8" 2023-06-08T22:50:54.452 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout:ANSI_COLOR="0;31" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.redhat.com/" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-08T22:50:54.453 INFO:teuthology.orchestra.run.smithi149.stdout: 2023-06-08T22:50:54.454 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-08T22:50:54.454 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-06-08T22:50:54.454 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-08T22:50:54.454 INFO:teuthology.orchestra.run.smithi149.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-06-08T22:50:54.454 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-06-08T22:50:54.572 INFO:teuthology.dispatcher.supervisor:Running job 7299653 2023-06-08T22:50:54.573 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299653 --name yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299653/orig.config.yaml 2023-06-08T22:50:54.577 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-06-08_20:56:35-fs-wip-yuri4-testing-2023-06-08-0857-quincy-distro-default-smithi/7299653 2023-06-08T22:50:54.578 INFO:teuthology.dispatcher.supervisor:Job PID: 24652 2023-06-08T22:50:54.578 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-08T23:04:55.843 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-08T23:04:55.971 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-08T23:04:55.972 INFO:teuthology.nuke:Checking targets against current locks 2023-06-08T23:04:56.039 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T23:04:56.060 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-08T23:04:56.115 INFO:teuthology.orchestra.console:Power off smithi123 2023-06-08T23:04:56.135 INFO:teuthology.orchestra.console:Power off smithi149 2023-06-08T23:04:56.266 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2023-06-08T23:04:56.279 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-06-08T23:04:56.417 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com 2023-06-08T23:04:56.433 INFO:teuthology.lock.ops:unlocked: smithi149.front.sepia.ceph.com