2022-12-26T14:29:09.740 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-26T14:29:10.270 INFO:teuthology.lock.ops:Start node 'smithi086.front.sepia.ceph.com' reimaging 2022-12-26T14:29:10.276 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:29:10.278 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2022-12-26T14:29:10.435 INFO:teuthology.lock.ops:Node 'smithi086.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:29:10.436 INFO:teuthology.lock.ops:Start node 'smithi143.front.sepia.ceph.com' reimaging 2022-12-26T14:29:10.436 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:29:10.437 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-12-26T14:29:10.475 INFO:teuthology.lock.ops:Node 'smithi143.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:29:10.784 INFO:teuthology.provision.fog.smithi086:Scheduling deploy of rhel 8.6 2022-12-26T14:29:10.796 INFO:teuthology.provision.fog.smithi143:Scheduling deploy of rhel 8.6 2022-12-26T14:29:11.489 INFO:teuthology.orchestra.console:Power off smithi086 2022-12-26T14:29:11.624 INFO:teuthology.orchestra.console:Power off smithi143 2022-12-26T14:29:20.255 INFO:teuthology.orchestra.console:Power off for smithi086 completed 2022-12-26T14:29:20.356 INFO:teuthology.orchestra.console:Power off for smithi143 completed 2022-12-26T14:29:20.358 INFO:teuthology.orchestra.console:Power on smithi086 2022-12-26T14:29:20.565 INFO:teuthology.orchestra.console:Power on smithi143 2022-12-26T14:29:24.932 INFO:teuthology.orchestra.console:Power on for smithi086 completed 2022-12-26T14:29:25.021 INFO:teuthology.orchestra.console:Power on for smithi143 completed 2022-12-26T14:29:25.122 INFO:teuthology.provision.fog.smithi086:Waiting for deploy to finish 2022-12-26T14:29:25.124 INFO:teuthology.provision.fog.smithi143:Waiting for deploy to finish 2022-12-26T14:32:14.415 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2022-12-26T14:32:14.450 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:32:23.561 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2022-12-26T14:32:23.562 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:32:32.654 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2022-12-26T14:32:32.655 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:32:41.742 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2022-12-26T14:32:41.744 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:32:50.833 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.143 2022-12-26T14:32:50.834 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:32:59.939 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.86 2022-12-26T14:33:56.896 WARNING:teuthology.provision.fog:timed out 2022-12-26T14:34:03.385 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:34:03.642 INFO:teuthology.provision.fog.smithi143:Node is ready 2022-12-26T14:34:03.661 INFO:teuthology.orchestra.run.smithi143.stdout:smithi143 2022-12-26T14:34:03.731 INFO:teuthology.orchestra.run.smithi143.stdout:172.21.15.143 smithi143.front.sepia.ceph.com smithi143 2022-12-26T14:34:04.116 INFO:teuthology.provision.fog.smithi143:Deploy complete! 2022-12-26T14:34:05.967 WARNING:teuthology.provision.fog:timed out 2022-12-26T14:34:12.326 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:34:12.650 INFO:teuthology.provision.fog.smithi086:Node is ready 2022-12-26T14:34:12.675 INFO:teuthology.orchestra.run.smithi086.stdout:smithi086.front.sepia.ceph.com 2022-12-26T14:34:12.742 INFO:teuthology.orchestra.run.smithi086.stdout:172.21.15.86 smithi086.front.sepia.ceph.com smithi086 2022-12-26T14:34:13.128 INFO:teuthology.provision.fog.smithi086:Deploy complete! 2022-12-26T14:34:13.470 INFO:teuthology.lock.ops:Checking smithi086.front.sepia.ceph.com 2022-12-26T14:34:13.470 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:34:13.492 INFO:teuthology.lock.ops:Checking smithi143.front.sepia.ceph.com 2022-12-26T14:34:13.493 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:34:13.554 INFO:teuthology.lock.ops:Updating [smithi086.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:34:13.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2022-12-26T14:34:14.096 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2022-12-26T14:34:14.202 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:34:14.202 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:34:14.204 INFO:teuthology.orchestra.run.smithi086.stdout:ID="rhel" 2022-12-26T14:34:14.204 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="fedora" 2022-12-26T14:34:14.205 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="8.6" 2022-12-26T14:34:14.205 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:34:14.205 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:34:14.206 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2022-12-26T14:34:14.206 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:34:14.206 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:34:14.207 INFO:teuthology.orchestra.run.smithi086.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:34:14.208 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:34:14.208 INFO:teuthology.orchestra.run.smithi086.stdout: 2022-12-26T14:34:14.208 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:34:14.209 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:34:14.209 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:34:14.209 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:34:14.211 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2022-12-26T14:34:14.236 INFO:teuthology.lock.ops:Updating [smithi143.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:34:14.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi143.front.sepia.ceph.com' 2022-12-26T14:34:14.640 INFO:teuthology.orchestra.run.smithi143.stdout:x86_64 2022-12-26T14:34:14.707 INFO:teuthology.orchestra.run.smithi143.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:34:14.708 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:34:14.708 INFO:teuthology.orchestra.run.smithi143.stdout:ID="rhel" 2022-12-26T14:34:14.708 INFO:teuthology.orchestra.run.smithi143.stdout:ID_LIKE="fedora" 2022-12-26T14:34:14.709 INFO:teuthology.orchestra.run.smithi143.stdout:VERSION_ID="8.6" 2022-12-26T14:34:14.709 INFO:teuthology.orchestra.run.smithi143.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:34:14.709 INFO:teuthology.orchestra.run.smithi143.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:34:14.710 INFO:teuthology.orchestra.run.smithi143.stdout:ANSI_COLOR="0;31" 2022-12-26T14:34:14.710 INFO:teuthology.orchestra.run.smithi143.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:34:14.711 INFO:teuthology.orchestra.run.smithi143.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:34:14.718 INFO:teuthology.orchestra.run.smithi143.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:34:14.718 INFO:teuthology.orchestra.run.smithi143.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:34:14.718 INFO:teuthology.orchestra.run.smithi143.stdout: 2022-12-26T14:34:14.719 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:34:14.719 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:34:14.719 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:34:14.720 INFO:teuthology.orchestra.run.smithi143.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:34:14.721 INFO:teuthology.lock.ops:Updating smithi143.front.sepia.ceph.com on lock server 2022-12-26T14:34:15.221 INFO:teuthology.dispatcher.supervisor:Running job 7127176 2022-12-26T14:34:15.221 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127176 --name nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127176/orig.config.yaml 2022-12-26T14:34:15.337 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127176 2022-12-26T14:34:15.338 INFO:teuthology.dispatcher.supervisor:Job PID: 13477 2022-12-26T14:34:15.338 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-26T15:16:19.080 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120