2022-12-26T14:19:09.571 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-26T14:19:09.908 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2022-12-26T14:19:09.910 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:19:09.910 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-12-26T14:19:09.940 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:19:09.941 INFO:teuthology.lock.ops:Start node 'smithi160.front.sepia.ceph.com' reimaging 2022-12-26T14:19:09.942 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:19:09.942 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2022-12-26T14:19:09.973 INFO:teuthology.lock.ops:Node 'smithi160.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:19:10.286 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of rhel 8.6 2022-12-26T14:19:10.288 INFO:teuthology.provision.fog.smithi160:Scheduling deploy of rhel 8.6 2022-12-26T14:19:10.761 INFO:teuthology.orchestra.console:Power off smithi160 2022-12-26T14:19:10.821 INFO:teuthology.orchestra.console:Power off smithi045 2022-12-26T14:19:19.274 INFO:teuthology.orchestra.console:Power off for smithi160 completed 2022-12-26T14:19:19.299 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2022-12-26T14:19:19.385 INFO:teuthology.orchestra.console:Power on smithi160 2022-12-26T14:19:19.416 INFO:teuthology.orchestra.console:Power on smithi045 2022-12-26T14:19:27.910 INFO:teuthology.orchestra.console:Power on for smithi160 completed 2022-12-26T14:19:27.942 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2022-12-26T14:19:28.012 INFO:teuthology.provision.fog.smithi160:Waiting for deploy to finish 2022-12-26T14:19:28.044 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2022-12-26T14:22:02.125 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2022-12-26T14:22:11.241 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2022-12-26T14:22:17.223 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:22:20.295 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2022-12-26T14:22:26.283 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:22:29.355 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.45 2022-12-26T14:22:35.376 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:22:44.474 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:22:53.543 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:23:02.599 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.160 2022-12-26T14:23:35.403 WARNING:teuthology.provision.fog:timed out 2022-12-26T14:23:41.817 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:23:42.132 INFO:teuthology.provision.fog.smithi045:Node is ready 2022-12-26T14:23:42.154 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2022-12-26T14:23:42.225 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2022-12-26T14:23:42.655 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2022-12-26T14:24:08.631 WARNING:teuthology.provision.fog:timed out 2022-12-26T14:24:15.023 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:24:15.317 INFO:teuthology.provision.fog.smithi160:Node is ready 2022-12-26T14:24:15.336 INFO:teuthology.orchestra.run.smithi160.stdout:smithi160.front.sepia.ceph.com 2022-12-26T14:24:15.394 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.15.160 smithi160.front.sepia.ceph.com smithi160 2022-12-26T14:24:15.820 INFO:teuthology.provision.fog.smithi160:Deploy complete! 2022-12-26T14:24:16.187 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2022-12-26T14:24:16.188 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:24:16.209 INFO:teuthology.lock.ops:Checking smithi160.front.sepia.ceph.com 2022-12-26T14:24:16.209 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:24:16.228 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:24:16.229 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2022-12-26T14:24:16.613 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2022-12-26T14:24:16.673 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:24:16.673 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:24:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:ID="rhel" 2022-12-26T14:24:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="fedora" 2022-12-26T14:24:16.674 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8.6" 2022-12-26T14:24:16.675 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:24:16.675 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:24:16.675 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2022-12-26T14:24:16.676 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:24:16.676 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:24:16.677 INFO:teuthology.orchestra.run.smithi045.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:24:16.677 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:24:16.677 INFO:teuthology.orchestra.run.smithi045.stdout: 2022-12-26T14:24:16.678 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:24:16.678 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:24:16.678 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:24:16.679 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:24:16.681 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-12-26T14:24:16.742 INFO:teuthology.lock.ops:Updating [smithi160.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:24:16.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2022-12-26T14:24:16.956 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2022-12-26T14:24:17.026 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:24:17.027 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:24:17.027 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2022-12-26T14:24:17.027 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2022-12-26T14:24:17.028 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2022-12-26T14:24:17.028 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:24:17.029 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:24:17.029 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2022-12-26T14:24:17.029 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:24:17.030 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:24:17.030 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:24:17.030 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:24:17.031 INFO:teuthology.orchestra.run.smithi160.stdout: 2022-12-26T14:24:17.031 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:24:17.032 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:24:17.032 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:24:17.032 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:24:17.033 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2022-12-26T14:24:17.289 INFO:teuthology.dispatcher.supervisor:Running job 7127159 2022-12-26T14:24:17.292 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127159 --name nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127159/orig.config.yaml 2022-12-26T14:24:17.334 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127159 2022-12-26T14:24:17.335 INFO:teuthology.dispatcher.supervisor:Job PID: 11931 2022-12-26T14:24:17.336 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-26T15:14:21.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120