2022-12-26T14:23:05.789 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-26T14:23:06.217 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2022-12-26T14:23:06.219 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:23:06.220 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-12-26T14:23:06.242 INFO:teuthology.lock.ops:Node 'smithi083.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:23:06.243 INFO:teuthology.lock.ops:Start node 'smithi142.front.sepia.ceph.com' reimaging 2022-12-26T14:23:06.245 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:23:06.290 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-12-26T14:23:06.328 INFO:teuthology.lock.ops:Node 'smithi142.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:23:06.483 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.6 2022-12-26T14:23:06.532 INFO:teuthology.provision.fog.smithi142:Scheduling deploy of rhel 8.6 2022-12-26T14:23:06.927 INFO:teuthology.orchestra.console:Power off smithi083 2022-12-26T14:23:07.045 INFO:teuthology.orchestra.console:Power off smithi142 2022-12-26T14:23:15.522 INFO:teuthology.orchestra.console:Power off for smithi142 completed 2022-12-26T14:23:15.571 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-12-26T14:23:15.623 INFO:teuthology.orchestra.console:Power on smithi142 2022-12-26T14:23:15.696 INFO:teuthology.orchestra.console:Power on smithi083 2022-12-26T14:23:24.105 INFO:teuthology.orchestra.console:Power on for smithi142 completed 2022-12-26T14:23:24.156 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2022-12-26T14:23:24.206 INFO:teuthology.provision.fog.smithi142:Waiting for deploy to finish 2022-12-26T14:23:24.261 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2022-12-26T14:25:58.328 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:07.463 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:13.420 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:26:16.551 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:22.507 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:26:25.615 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:31.591 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:26:34.703 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:40.651 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:26:43.817 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:49.742 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:26:52.903 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:26:58.823 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.83 2022-12-26T14:27:17.383 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:27:26.475 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.142 2022-12-26T14:27:32.968 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:27:33.312 INFO:teuthology.provision.fog.smithi142:Node is ready 2022-12-26T14:27:33.338 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142.front.sepia.ceph.com 2022-12-26T14:27:33.395 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142 smithi142.front.sepia.ceph.com smithi142 2022-12-26T14:27:33.913 INFO:teuthology.provision.fog.smithi142:Deploy complete! 2022-12-26T14:27:36.770 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:27:37.072 INFO:teuthology.provision.fog.smithi083:Node is ready 2022-12-26T14:27:37.100 INFO:teuthology.orchestra.run.smithi083.stdout:smithi022 2022-12-26T14:27:37.172 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2022-12-26T14:27:37.607 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2022-12-26T14:27:38.179 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2022-12-26T14:27:38.180 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:27:38.227 INFO:teuthology.lock.ops:Checking smithi142.front.sepia.ceph.com 2022-12-26T14:27:38.228 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:27:38.299 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:27:38.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-12-26T14:27:38.666 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2022-12-26T14:27:38.738 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:27:38.739 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:27:38.739 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2022-12-26T14:27:38.740 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2022-12-26T14:27:38.740 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.6" 2022-12-26T14:27:38.740 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:27:38.741 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:27:38.741 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2022-12-26T14:27:38.742 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:27:38.746 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:27:38.746 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:27:38.746 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:27:38.747 INFO:teuthology.orchestra.run.smithi083.stdout: 2022-12-26T14:27:38.747 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:27:38.747 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:27:38.747 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:27:38.748 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:27:38.749 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-12-26T14:27:38.805 INFO:teuthology.lock.ops:Updating [smithi142.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:27:38.806 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2022-12-26T14:27:39.182 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2022-12-26T14:27:39.264 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:27:39.264 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:27:39.265 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2022-12-26T14:27:39.265 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2022-12-26T14:27:39.266 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2022-12-26T14:27:39.266 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:27:39.266 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:27:39.278 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2022-12-26T14:27:39.279 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:27:39.279 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:27:39.280 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:27:39.280 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:27:39.281 INFO:teuthology.orchestra.run.smithi142.stdout: 2022-12-26T14:27:39.281 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:27:39.282 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:27:39.282 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:27:39.283 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:27:39.296 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2022-12-26T14:27:39.580 INFO:teuthology.dispatcher.supervisor:Running job 7127167 2022-12-26T14:27:39.581 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127167 --name nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127167/orig.config.yaml 2022-12-26T14:27:39.721 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127167 2022-12-26T14:27:39.728 INFO:teuthology.dispatcher.supervisor:Job PID: 29307 2022-12-26T14:27:39.729 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-26T15:15:44.565 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120