2023-06-09T15:58:09.609 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T15:58:09.763 INFO:teuthology.lock.ops:Start node 'smithi016.front.sepia.ceph.com' reimaging 2023-06-09T15:58:09.765 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T15:58:09.765 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-06-09T15:58:09.788 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging 2023-06-09T15:58:09.788 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server 2023-06-09T15:58:09.788 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-06-09T15:58:09.939 INFO:teuthology.provision.fog.smithi016:Scheduling deploy of rhel 8.6 2023-06-09T15:58:09.953 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of rhel 8.6 2023-06-09T15:58:10.156 INFO:teuthology.orchestra.console:Power off smithi016 2023-06-09T15:58:10.196 INFO:teuthology.orchestra.console:Power off smithi121 2023-06-09T15:58:10.305 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2023-06-09T15:58:10.335 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2023-06-09T15:58:10.407 INFO:teuthology.orchestra.console:Power on smithi016 2023-06-09T15:58:10.437 INFO:teuthology.orchestra.console:Power on smithi121 2023-06-09T15:58:18.780 INFO:teuthology.orchestra.console:Power on for smithi016 completed 2023-06-09T15:58:18.794 INFO:teuthology.orchestra.console:Power on for smithi121 completed 2023-06-09T15:58:18.881 INFO:teuthology.provision.fog.smithi016:Waiting for deploy to finish 2023-06-09T15:58:18.895 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish 2023-06-09T16:01:07.824 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:01:07.825 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-09T16:01:16.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:01:16.913 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-09T16:01:25.968 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:01:26.000 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-09T16:01:35.024 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:01:35.056 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-09T16:01:44.112 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-06-09T16:01:44.113 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:01:53.200 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.121 2023-06-09T16:02:50.166 WARNING:teuthology.provision.fog:timed out 2023-06-09T16:02:56.512 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T16:02:56.819 INFO:teuthology.provision.fog.smithi016:Node is ready 2023-06-09T16:02:56.838 INFO:teuthology.orchestra.run.smithi016.stdout:smithi016.front.sepia.ceph.com 2023-06-09T16:02:56.897 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.15.16 smithi016.front.sepia.ceph.com smithi016 2023-06-09T16:02:57.317 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T16:02:57.317 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T16:02:57.317 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-06-09T16:02:57.317 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T16:02:57.318 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T16:02:57.319 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T16:02:57.320 INFO:teuthology.provision.fog.smithi016:Deploy complete! 2023-06-09T16:02:59.207 WARNING:teuthology.provision.fog:timed out 2023-06-09T16:03:05.546 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-06-09T16:03:05.878 INFO:teuthology.provision.fog.smithi121:Node is ready 2023-06-09T16:03:05.897 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com 2023-06-09T16:03:05.956 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121 2023-06-09T16:03:06.353 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T16:03:06.354 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T16:03:06.355 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T16:03:06.356 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T16:03:06.356 INFO:teuthology.provision.fog.smithi121:Deploy complete! 2023-06-09T16:03:06.534 INFO:teuthology.lock.ops:Checking smithi016.front.sepia.ceph.com 2023-06-09T16:03:06.535 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T16:03:06.556 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com 2023-06-09T16:03:06.556 INFO:teuthology.lock.ops:New key found. Updating... 2023-06-09T16:03:06.582 INFO:teuthology.lock.ops:Updating [smithi016.front.sepia.ceph.com]: set os type and version on server 2023-06-09T16:03:06.582 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-06-09T16:03:06.780 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-06-09T16:03:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T16:03:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T16:03:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID="rhel" 2023-06-09T16:03:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE="fedora" 2023-06-09T16:03:06.839 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="8.6" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM_ID="platform:el8" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:ANSI_COLOR="0;31" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T16:03:06.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-06-09T16:03:06.841 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T16:03:06.841 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T16:03:06.841 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T16:03:06.841 INFO:teuthology.orchestra.run.smithi016.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T16:03:06.841 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-06-09T16:03:06.865 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server 2023-06-09T16:03:06.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2023-06-09T16:03:07.053 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2023-06-09T16:03:07.110 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux" 2023-06-09T16:03:07.110 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.6 (Ootpa)" 2023-06-09T16:03:07.110 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel" 2023-06-09T16:03:07.110 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora" 2023-06-09T16:03:07.110 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.6" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-06-09T16:03:07.111 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-06-09T16:03:07.112 INFO:teuthology.orchestra.run.smithi121.stdout: 2023-06-09T16:03:07.112 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-06-09T16:03:07.112 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-06-09T16:03:07.112 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-06-09T16:03:07.112 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-06-09T16:03:07.112 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2023-06-09T16:03:07.240 INFO:teuthology.dispatcher.supervisor:Running job 7299923 2023-06-09T16:03:07.240 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61/virtualenv/bin/teuthology -v --owner scheduled_prsrivas@teuthology --archive /home/teuthworker/archive/prsrivas-2023-06-09_15:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7299923 --name prsrivas-2023-06-09_15:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi --description rgw:verify/{0-install clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{rhel_8} tasks/{cls ragweed reshard s3tests-java s3tests} validater/valgrind} -- /home/teuthworker/archive/prsrivas-2023-06-09_15:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7299923/orig.config.yaml 2023-06-09T16:03:07.243 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/prsrivas-2023-06-09_15:56:54-rgw:verify-wip-rgw-d3n-filter-distro-default-smithi/7299923 2023-06-09T16:03:07.244 INFO:teuthology.dispatcher.supervisor:Job PID: 32252 2023-06-09T16:03:07.244 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-06-09T16:27:09.085 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120 2023-06-09T16:27:09.278 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2023-06-09T16:27:09.279 INFO:teuthology.nuke:Checking targets against current locks 2023-06-09T16:27:09.335 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T16:27:09.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T16:27:09.414 INFO:teuthology.orchestra.console:Power off smithi016 2023-06-09T16:27:09.435 INFO:teuthology.orchestra.console:Power off smithi121 2023-06-09T16:27:09.565 INFO:teuthology.orchestra.console:Power off for smithi016 completed 2023-06-09T16:27:09.574 INFO:teuthology.orchestra.console:Power off for smithi121 completed 2023-06-09T16:27:09.717 INFO:teuthology.lock.ops:unlocked: smithi016.front.sepia.ceph.com 2023-06-09T16:27:09.725 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com