2023-03-29T09:43:00.797 INFO:root:teuthology version: 0.0.1.dev78+ge372916 2023-03-29T09:43:01.036 INFO:teuthology.lock.ops:Start node 'smithi088.front.sepia.ceph.com' reimaging 2023-03-29T09:43:01.037 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: reset os type and version on server 2023-03-29T09:43:01.037 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-03-29T09:43:01.062 INFO:teuthology.lock.ops:Node 'smithi088.front.sepia.ceph.com' reimaging is complete 2023-03-29T09:43:01.062 INFO:teuthology.lock.ops:Start node 'smithi118.front.sepia.ceph.com' reimaging 2023-03-29T09:43:01.062 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: reset os type and version on server 2023-03-29T09:43:01.062 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-03-29T09:43:01.091 INFO:teuthology.lock.ops:Node 'smithi118.front.sepia.ceph.com' reimaging is complete 2023-03-29T09:43:01.091 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2023-03-29T09:43:01.091 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2023-03-29T09:43:01.091 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-03-29T09:43:01.116 INFO:teuthology.lock.ops:Node 'smithi143.front.sepia.ceph.com' reimaging is complete 2023-03-29T09:43:01.116 INFO:teuthology.lock.ops:Start node 'smithi179.front.sepia.ceph.com' reimaging 2023-03-29T09:43:01.116 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: reset os type and version on server 2023-03-29T09:43:01.116 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-03-29T09:43:01.143 INFO:teuthology.lock.ops:Node 'smithi179.front.sepia.ceph.com' reimaging is complete 2023-03-29T09:43:01.250 INFO:teuthology.provision.fog.smithi088:Scheduling deploy of rhel 8.6 2023-03-29T09:43:01.253 INFO:teuthology.provision.fog.smithi118:Scheduling deploy of rhel 8.6 2023-03-29T09:43:01.292 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.6 2023-03-29T09:43:01.339 INFO:teuthology.provision.fog.smithi179:Scheduling deploy of rhel 8.6 2023-03-29T09:43:01.560 INFO:teuthology.orchestra.console:Power off smithi088 2023-03-29T09:43:01.580 INFO:teuthology.orchestra.console:Power off smithi143 2023-03-29T09:43:01.597 INFO:teuthology.orchestra.console:Power off smithi118 2023-03-29T09:43:01.662 INFO:teuthology.orchestra.console:Power off smithi179 2023-03-29T09:43:09.969 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-03-29T09:43:09.977 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-03-29T09:43:10.000 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-03-29T09:43:10.038 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-03-29T09:43:10.070 INFO:teuthology.orchestra.console:Power on smithi143 2023-03-29T09:43:10.081 INFO:teuthology.orchestra.console:Power on smithi088 2023-03-29T09:43:10.102 INFO:teuthology.orchestra.console:Power on smithi118 2023-03-29T09:43:10.138 INFO:teuthology.orchestra.console:Power on smithi179 2023-03-29T09:43:14.347 INFO:teuthology.orchestra.console:Power on for smithi088 completed 2023-03-29T09:43:14.447 INFO:teuthology.provision.fog.smithi088:Waiting for deploy to finish 2023-03-29T09:43:18.447 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2023-03-29T09:43:18.473 INFO:teuthology.orchestra.console:Power on for smithi118 completed 2023-03-29T09:43:18.549 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2023-03-29T09:43:18.552 INFO:teuthology.orchestra.console:Power on for smithi179 completed 2023-03-29T09:43:18.575 INFO:teuthology.provision.fog.smithi118:Waiting for deploy to finish 2023-03-29T09:43:18.653 INFO:teuthology.provision.fog.smithi179:Waiting for deploy to finish 2023-03-29T09:46:07.525 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:07.557 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:16.581 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:16.617 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:18.569 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:46:25.637 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:25.701 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:27.621 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:46:34.697 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:34.761 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:36.677 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:46:43.753 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:43.813 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:45.733 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:46:52.805 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:46:52.869 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.179 2023-03-29T09:46:54.789 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:47:01.865 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2023-03-29T09:47:03.845 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:47:12.901 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:47:19.810 ERROR:teuthology.orchestra.connection:Error authenticating with smithi118.front.sepia.ceph.com: Authentication timeout. 2023-03-29T09:47:21.477 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-03-29T09:47:21.957 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-03-29T09:47:30.537 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.118 2023-03-29T09:47:58.871 WARNING:teuthology.provision.fog:timed out 2023-03-29T09:48:05.208 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-29T09:48:05.498 INFO:teuthology.provision.fog.smithi179:Node is ready 2023-03-29T09:48:05.517 INFO:teuthology.orchestra.run.smithi179.stdout:smithi179 2023-03-29T09:48:05.577 INFO:teuthology.orchestra.run.smithi179.stdout:172.21.15.179 smithi179.front.sepia.ceph.com smithi179 2023-03-29T09:48:05.925 INFO:teuthology.provision.fog.smithi179:Deploy complete! 2023-03-29T09:48:07.867 WARNING:teuthology.provision.fog:timed out 2023-03-29T09:48:14.193 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-29T09:48:14.457 INFO:teuthology.provision.fog.smithi143:Node is ready 2023-03-29T09:48:14.475 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143 2023-03-29T09:48:14.535 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2023-03-29T09:48:14.889 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2023-03-29T09:48:27.960 WARNING:teuthology.provision.fog:timed out 2023-03-29T09:48:34.300 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-29T09:48:34.570 INFO:teuthology.provision.fog.smithi088:Node is ready 2023-03-29T09:48:34.587 INFO:teuthology.orchestra.run.smithi088.stdout:smithi088 2023-03-29T09:48:34.644 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.15.88 smithi088.front.sepia.ceph.com smithi088 2023-03-29T09:48:34.979 INFO:teuthology.provision.fog.smithi088:Deploy complete! 2023-03-29T09:48:36.539 WARNING:teuthology.provision.fog:timed out 2023-03-29T09:48:42.871 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-03-29T09:48:43.180 INFO:teuthology.provision.fog.smithi118:Node is ready 2023-03-29T09:48:43.198 INFO:teuthology.orchestra.run.smithi118.stdout:smithi118 2023-03-29T09:48:43.255 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.15.118 smithi118.front.sepia.ceph.com smithi118 2023-03-29T09:48:43.601 INFO:teuthology.provision.fog.smithi118:Deploy complete! 2023-03-29T09:48:43.848 INFO:teuthology.lock.ops:Checking smithi088.front.sepia.ceph.com 2023-03-29T09:48:43.848 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-29T09:48:43.876 INFO:teuthology.lock.ops:Checking smithi118.front.sepia.ceph.com 2023-03-29T09:48:43.876 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-29T09:48:43.900 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2023-03-29T09:48:43.900 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-29T09:48:43.917 INFO:teuthology.lock.ops:Checking smithi179.front.sepia.ceph.com 2023-03-29T09:48:43.917 INFO:teuthology.lock.ops:New key found. Updating... 2023-03-29T09:48:43.935 INFO:teuthology.lock.ops:Updating [smithi088.front.sepia.ceph.com]: set os type and version on server 2023-03-29T09:48:43.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-03-29T09:48:44.131 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-03-29T09:48:44.190 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.6 (Ootpa)" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.6" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-29T09:48:44.191 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-29T09:48:44.192 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-03-29T09:48:44.217 INFO:teuthology.lock.ops:Updating [smithi118.front.sepia.ceph.com]: set os type and version on server 2023-03-29T09:48:44.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-03-29T09:48:44.404 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2023-03-29T09:48:44.421 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="Red Hat Enterprise Linux" 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="8.6 (Ootpa)" 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:ID="rhel" 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="fedora" 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="8.6" 2023-03-29T09:48:44.458 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el8" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://www.redhat.com/" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout: 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-29T09:48:44.459 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-29T09:48:44.460 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2023-03-29T09:48:44.484 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2023-03-29T09:48:44.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-03-29T09:48:44.739 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-29T09:48:44.797 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout: 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-29T09:48:44.798 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-29T09:48:44.799 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2023-03-29T09:48:44.826 INFO:teuthology.lock.ops:Updating [smithi179.front.sepia.ceph.com]: set os type and version on server 2023-03-29T09:48:44.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-03-29T09:48:45.087 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2023-03-29T09:48:45.143 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Red Hat Enterprise Linux" 2023-03-29T09:48:45.143 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="8.6 (Ootpa)" 2023-03-29T09:48:45.143 INFO:teuthology.orchestra.run.smithi179.stdout:ID="rhel" 2023-03-29T09:48:45.143 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE="fedora" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="8.6" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:PLATFORM_ID="platform:el8" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:ANSI_COLOR="0;31" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.redhat.com/" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout: 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-03-29T09:48:45.144 INFO:teuthology.orchestra.run.smithi179.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-03-29T09:48:45.145 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2023-03-29T09:48:45.256 INFO:teuthology.dispatcher.supervisor:Running job 7224266 2023-03-29T09:48:45.256 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_e3729161eecf8e6d09a4069acbb883cdcd5e9f50/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2023-03-28_22:46:34-rados-WIP_GBH_snap_mapper_B-distro-default-smithi/7224266 --name benhanokh-2023-03-28_22:46:34-rados-WIP_GBH_snap_mapper_B-distro-default-smithi --description rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} -- /home/teuthworker/archive/benhanokh-2023-03-28_22:46:34-rados-WIP_GBH_snap_mapper_B-distro-default-smithi/7224266/orig.config.yaml 2023-03-29T09:48:45.260 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2023-03-28_22:46:34-rados-WIP_GBH_snap_mapper_B-distro-default-smithi/7224266 2023-03-29T09:48:45.260 INFO:teuthology.dispatcher.supervisor:Job PID: 1266 2023-03-29T09:48:45.260 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-03-29T21:49:43.318 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-03-29T21:49:43.481 INFO:teuthology.kill:Killing Pids: {1266} 2023-03-29T21:49:44.328 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'osd.0', 'osd.4', 'osd.8', 'osd.12'] 2023-03-29T21:49:44.329 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'osd.1', 'osd.5', 'osd.9', 'osd.13'] 2023-03-29T21:49:44.329 INFO:teuthology.task.internal:roles: ubuntu@smithi143.front.sepia.ceph.com - ['mon.c', 'osd.2', 'osd.6', 'osd.10', 'osd.14'] 2023-03-29T21:49:44.329 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mgr.x', 'osd.3', 'osd.7', 'osd.11', 'osd.15', 'client.0'] 2023-03-29T21:49:44.329 INFO:teuthology.misc:Compressing logs... 2023-03-29T21:49:44.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-03-29T21:49:44.516 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2023-03-29T21:49:44.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2023-03-29T21:49:44.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2023-03-29T21:49:45.606 INFO:teuthology.misc:Compressing logs... 2023-03-29T21:49:46.207 INFO:teuthology.orchestra.run.smithi118.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-29T21:49:46.210 INFO:teuthology.orchestra.run.smithi143.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-29T21:49:46.242 INFO:teuthology.orchestra.run.smithi179.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2023-03-29T21:51:56.363 INFO:teuthology.misc:Compressing logs... 2023-03-29T21:51:59.443 INFO:teuthology.kill:No teuthology processes running 2023-03-29T21:52:00.310 INFO:teuthology.kill:Nuking machines: ['smithi088', 'smithi118', 'smithi143', 'smithi179'] 2023-03-29T21:52:00.940 INFO:teuthology.kill:2023-03-29 21:52:00,939.939 INFO:teuthology.nuke:targets: 2023-03-29T21:52:00.940 INFO:teuthology.kill: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-03-29T21:52:00.940 INFO:teuthology.kill: smithi118.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-29T21:52:00.940 INFO:teuthology.kill: smithi143.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= 2023-03-29T21:52:00.940 INFO:teuthology.kill: smithi179.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= 2023-03-29T21:52:00.941 INFO:teuthology.kill:2023-03-29 21:52:00,940.940 INFO:teuthology.nuke:Checking targets against current locks 2023-03-29T21:52:00.997 INFO:teuthology.kill:2023-03-29 21:52:00,997.997 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-29T21:52:01.019 INFO:teuthology.kill:2023-03-29 21:52:01,019.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-29T21:52:01.047 INFO:teuthology.kill:2023-03-29 21:52:01,047.047 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-29T21:52:01.063 INFO:teuthology.kill:2023-03-29 21:52:01,063.063 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-03-29T21:52:01.077 INFO:teuthology.kill:2023-03-29 21:52:01,077.077 INFO:teuthology.orchestra.console:Power off smithi088 2023-03-29T21:52:01.116 INFO:teuthology.kill:2023-03-29 21:52:01,116.116 INFO:teuthology.orchestra.console:Power off smithi118 2023-03-29T21:52:01.159 INFO:teuthology.kill:2023-03-29 21:52:01,159.159 INFO:teuthology.orchestra.console:Power off smithi143 2023-03-29T21:52:01.174 INFO:teuthology.kill:2023-03-29 21:52:01,173.173 INFO:teuthology.orchestra.console:Power off smithi179 2023-03-29T21:52:09.459 INFO:teuthology.kill:2023-03-29 21:52:09,459.459 INFO:teuthology.orchestra.console:Power off for smithi088 completed 2023-03-29T21:52:09.504 INFO:teuthology.kill:2023-03-29 21:52:09,503.503 INFO:teuthology.orchestra.console:Power off for smithi118 completed 2023-03-29T21:52:09.541 INFO:teuthology.kill:2023-03-29 21:52:09,541.541 INFO:teuthology.orchestra.console:Power off for smithi179 completed 2023-03-29T21:52:09.621 INFO:teuthology.kill:2023-03-29 21:52:09,620.620 INFO:teuthology.lock.ops:unlocked: smithi088.front.sepia.ceph.com 2023-03-29T21:52:09.652 INFO:teuthology.kill:2023-03-29 21:52:09,651.651 INFO:teuthology.lock.ops:unlocked: smithi118.front.sepia.ceph.com 2023-03-29T21:52:09.692 INFO:teuthology.kill:2023-03-29 21:52:09,692.692 INFO:teuthology.lock.ops:unlocked: smithi179.front.sepia.ceph.com 2023-03-29T21:52:13.636 INFO:teuthology.kill:2023-03-29 21:52:13,636.636 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2023-03-29T21:52:13.792 INFO:teuthology.kill:2023-03-29 21:52:13,792.792 INFO:teuthology.lock.ops:unlocked: smithi143.front.sepia.ceph.com 2023-03-29T21:54:14.137 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2023-03-29T21:54:14.299 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi088 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-03-29_20:47:34-rgw-wip-cbodley-testing-distro-default-smithi/7225882 2023-03-29T21:54:14.299 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi118 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-03-29_20:47:34-rgw-wip-cbodley-testing-distro-default-smithi/7225880 2023-03-29T21:54:14.299 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi143 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-03-29_20:47:34-rgw-wip-cbodley-testing-distro-default-smithi/7225881 2023-03-29T21:54:14.300 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi179 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-03-29_20:47:34-rgw-wip-cbodley-testing-distro-default-smithi/7225882