2022-12-26T14:20:10.471 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-26T14:20:10.790 INFO:teuthology.lock.ops:Start node 'smithi063.front.sepia.ceph.com' reimaging 2022-12-26T14:20:10.793 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:20:10.793 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2022-12-26T14:20:10.820 INFO:teuthology.lock.ops:Node 'smithi063.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:20:10.820 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2022-12-26T14:20:10.821 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2022-12-26T14:20:10.822 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-12-26T14:20:10.856 INFO:teuthology.lock.ops:Node 'smithi181.front.sepia.ceph.com' reimaging is complete 2022-12-26T14:20:11.063 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of rhel 8.6 2022-12-26T14:20:11.069 INFO:teuthology.provision.fog.smithi063:Scheduling deploy of rhel 8.6 2022-12-26T14:20:11.385 INFO:teuthology.orchestra.console:Power off smithi181 2022-12-26T14:20:11.469 INFO:teuthology.orchestra.console:Power off smithi063 2022-12-26T14:20:20.043 INFO:teuthology.orchestra.console:Power off for smithi063 completed 2022-12-26T14:20:20.145 INFO:teuthology.orchestra.console:Power on smithi063 2022-12-26T14:20:20.912 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-12-26T14:20:21.014 INFO:teuthology.orchestra.console:Power on smithi181 2022-12-26T14:20:25.329 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2022-12-26T14:20:25.439 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2022-12-26T14:20:28.595 INFO:teuthology.orchestra.console:Power on for smithi063 completed 2022-12-26T14:20:28.709 INFO:teuthology.provision.fog.smithi063:Waiting for deploy to finish 2022-12-26T14:23:14.796 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:23:17.962 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:23:23.912 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:23:27.051 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:23:32.967 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:23:36.108 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:23:42.064 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:23:45.167 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:23:51.148 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:23:54.247 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:24:00.251 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.181 2022-12-26T14:24:03.304 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.63 2022-12-26T14:24:38.308 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:24:38.543 INFO:teuthology.provision.fog.smithi181:Node is ready 2022-12-26T14:24:38.582 INFO:teuthology.orchestra.run.smithi181.stdout:smithi022 2022-12-26T14:24:38.649 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.22 smithi022.front.sepia.ceph.com smithi022 2022-12-26T14:24:39.016 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2022-12-26T14:25:09.347 WARNING:teuthology.provision.fog:timed out 2022-12-26T14:25:15.763 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-12-26T14:25:16.091 INFO:teuthology.provision.fog.smithi063:Node is ready 2022-12-26T14:25:16.160 INFO:teuthology.orchestra.run.smithi063.stdout:smithi063 2022-12-26T14:25:16.289 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.15.63 smithi063.front.sepia.ceph.com smithi063 2022-12-26T14:25:16.858 INFO:teuthology.provision.fog.smithi063:Deploy complete! 2022-12-26T14:25:17.547 INFO:teuthology.lock.ops:Checking smithi063.front.sepia.ceph.com 2022-12-26T14:25:17.553 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:25:17.605 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2022-12-26T14:25:17.606 INFO:teuthology.lock.ops:New key found. Updating... 2022-12-26T14:25:17.637 INFO:teuthology.lock.ops:Updating [smithi063.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:25:17.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2022-12-26T14:25:17.907 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2022-12-26T14:25:17.980 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:25:18.020 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:25:18.020 INFO:teuthology.orchestra.run.smithi063.stdout:ID="rhel" 2022-12-26T14:25:18.021 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="fedora" 2022-12-26T14:25:18.021 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8.6" 2022-12-26T14:25:18.022 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:25:18.022 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:25:18.022 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2022-12-26T14:25:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:25:18.072 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:25:18.072 INFO:teuthology.orchestra.run.smithi063.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:25:18.073 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:25:18.073 INFO:teuthology.orchestra.run.smithi063.stdout: 2022-12-26T14:25:18.082 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:25:18.091 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:25:18.091 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:25:18.091 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:25:18.093 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2022-12-26T14:25:18.128 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2022-12-26T14:25:18.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2022-12-26T14:25:18.472 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2022-12-26T14:25:18.530 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="Red Hat Enterprise Linux" 2022-12-26T14:25:18.531 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8.6 (Ootpa)" 2022-12-26T14:25:18.531 INFO:teuthology.orchestra.run.smithi181.stdout:ID="rhel" 2022-12-26T14:25:18.532 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="fedora" 2022-12-26T14:25:18.559 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8.6" 2022-12-26T14:25:18.560 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2022-12-26T14:25:18.560 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-12-26T14:25:18.560 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2022-12-26T14:25:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-12-26T14:25:18.561 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://www.redhat.com/" 2022-12-26T14:25:18.569 INFO:teuthology.orchestra.run.smithi181.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-12-26T14:25:18.575 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-12-26T14:25:18.575 INFO:teuthology.orchestra.run.smithi181.stdout: 2022-12-26T14:25:18.575 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-12-26T14:25:18.575 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-12-26T14:25:18.576 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-12-26T14:25:18.576 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-12-26T14:25:18.577 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-12-26T14:25:18.801 INFO:teuthology.dispatcher.supervisor:Running job 7127160 2022-12-26T14:25:18.804 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_nmordech@teuthology --archive /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127160 --name nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} -- /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127160/orig.config.yaml 2022-12-26T14:25:18.890 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/nmordech-2022-12-26_12:46:37-rados:thrash-erasure-code-wip-nitzan-peering-auth-log-shard-change-in-interval-distro-default-smithi/7127160 2022-12-26T14:25:18.891 INFO:teuthology.dispatcher.supervisor:Job PID: 23696 2022-12-26T14:25:18.892 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-12-26T15:15:23.308 ERROR:teuthology.dispatcher.supervisor:Child exited with code 120