2022-07-21T20:37:47.980 INFO:root:teuthology version: 1.1.1.dev384+g360d4be9 2022-07-21T20:37:48.217 INFO:teuthology.lock.ops:Start node 'smithi027.front.sepia.ceph.com' reimaging 2022-07-21T20:37:48.221 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: reset os type and version on server 2022-07-21T20:37:48.226 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-07-21T20:37:48.262 INFO:teuthology.lock.ops:Node 'smithi027.front.sepia.ceph.com' reimaging is complete 2022-07-21T20:37:48.262 INFO:teuthology.lock.ops:Start node 'smithi062.front.sepia.ceph.com' reimaging 2022-07-21T20:37:48.262 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: reset os type and version on server 2022-07-21T20:37:48.263 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-07-21T20:37:48.286 INFO:teuthology.lock.ops:Node 'smithi062.front.sepia.ceph.com' reimaging is complete 2022-07-21T20:37:48.287 INFO:teuthology.lock.ops:Start node 'smithi123.front.sepia.ceph.com' reimaging 2022-07-21T20:37:48.287 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: reset os type and version on server 2022-07-21T20:37:48.288 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-07-21T20:37:48.318 INFO:teuthology.lock.ops:Node 'smithi123.front.sepia.ceph.com' reimaging is complete 2022-07-21T20:37:48.511 INFO:teuthology.provision.fog.smithi027:Scheduling deploy of rhel 8.6 2022-07-21T20:37:48.557 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.6 2022-07-21T20:37:48.576 INFO:teuthology.provision.fog.smithi062:Scheduling deploy of rhel 8.6 2022-07-21T20:37:49.013 INFO:teuthology.orchestra.console:Power off smithi027 2022-07-21T20:37:49.035 INFO:teuthology.orchestra.console:Power off smithi123 2022-07-21T20:37:49.057 INFO:teuthology.orchestra.console:Power off smithi062 2022-07-21T20:37:49.200 INFO:teuthology.orchestra.console:Power off for smithi027 completed 2022-07-21T20:37:49.206 INFO:teuthology.orchestra.console:Power off for smithi123 completed 2022-07-21T20:37:49.216 INFO:teuthology.orchestra.console:Power off for smithi062 completed 2022-07-21T20:37:49.302 INFO:teuthology.orchestra.console:Power on smithi027 2022-07-21T20:37:49.310 INFO:teuthology.orchestra.console:Power on smithi123 2022-07-21T20:37:49.319 INFO:teuthology.orchestra.console:Power on smithi062 2022-07-21T20:37:53.572 INFO:teuthology.orchestra.console:Power on for smithi027 completed 2022-07-21T20:37:53.592 INFO:teuthology.orchestra.console:Power on for smithi062 completed 2022-07-21T20:37:53.675 INFO:teuthology.provision.fog.smithi027:Waiting for deploy to finish 2022-07-21T20:37:53.693 INFO:teuthology.provision.fog.smithi062:Waiting for deploy to finish 2022-07-21T20:37:57.693 INFO:teuthology.orchestra.console:Power on for smithi123 completed 2022-07-21T20:37:57.795 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish 2022-07-21T20:41:30.294 ERROR:teuthology.orchestra.connection:Error authenticating with smithi123.front.sepia.ceph.com: Authentication timeout. 2022-07-21T20:42:08.965 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-21T20:42:12.056 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-21T20:42:34.412 INFO:teuthology.provision.fog.smithi062:Node is ready 2022-07-21T20:42:34.438 INFO:teuthology.orchestra.run.smithi062.stdout:smithi062.front.sepia.ceph.com 2022-07-21T20:42:34.497 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.15.62 smithi062.front.sepia.ceph.com smithi062 2022-07-21T20:42:34.861 INFO:teuthology.provision.fog.smithi062:Deploy complete! 2022-07-21T20:42:37.424 INFO:teuthology.provision.fog.smithi123:Node is ready 2022-07-21T20:42:37.444 INFO:teuthology.orchestra.run.smithi123.stdout:smithi123.front.sepia.ceph.com 2022-07-21T20:42:37.501 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.123 smithi123.front.sepia.ceph.com smithi123 2022-07-21T20:42:37.885 INFO:teuthology.provision.fog.smithi123:Deploy complete! 2022-07-21T20:42:47.930 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2022-07-21T20:43:40.031 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-21T20:44:00.329 INFO:teuthology.provision.fog.smithi027:Node is ready 2022-07-21T20:44:00.348 INFO:teuthology.orchestra.run.smithi027.stdout:smithi027.front.sepia.ceph.com 2022-07-21T20:44:00.407 INFO:teuthology.orchestra.run.smithi027.stdout:172.21.15.27 smithi027.front.sepia.ceph.com smithi027 2022-07-21T20:44:00.781 INFO:teuthology.provision.fog.smithi027:Deploy complete! 2022-07-21T20:44:00.988 INFO:teuthology.lock.ops:Checking smithi027.front.sepia.ceph.com 2022-07-21T20:44:00.989 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-21T20:44:01.009 INFO:teuthology.lock.ops:Checking smithi062.front.sepia.ceph.com 2022-07-21T20:44:01.010 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-21T20:44:01.034 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com 2022-07-21T20:44:01.036 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-21T20:44:01.062 INFO:teuthology.lock.ops:Updating [smithi027.front.sepia.ceph.com]: set os type and version on server 2022-07-21T20:44:01.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi027.front.sepia.ceph.com' 2022-07-21T20:44:01.368 INFO:teuthology.orchestra.run.smithi027.stdout:x86_64 2022-07-21T20:44:01.425 INFO:teuthology.orchestra.run.smithi027.stdout:NAME="Red Hat Enterprise Linux" 2022-07-21T20:44:01.426 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION="8.6 (Ootpa)" 2022-07-21T20:44:01.426 INFO:teuthology.orchestra.run.smithi027.stdout:ID="rhel" 2022-07-21T20:44:01.427 INFO:teuthology.orchestra.run.smithi027.stdout:ID_LIKE="fedora" 2022-07-21T20:44:01.428 INFO:teuthology.orchestra.run.smithi027.stdout:VERSION_ID="8.6" 2022-07-21T20:44:01.428 INFO:teuthology.orchestra.run.smithi027.stdout:PLATFORM_ID="platform:el8" 2022-07-21T20:44:01.429 INFO:teuthology.orchestra.run.smithi027.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-21T20:44:01.429 INFO:teuthology.orchestra.run.smithi027.stdout:ANSI_COLOR="0;31" 2022-07-21T20:44:01.429 INFO:teuthology.orchestra.run.smithi027.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-21T20:44:01.430 INFO:teuthology.orchestra.run.smithi027.stdout:HOME_URL="https://www.redhat.com/" 2022-07-21T20:44:01.430 INFO:teuthology.orchestra.run.smithi027.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-21T20:44:01.431 INFO:teuthology.orchestra.run.smithi027.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-21T20:44:01.431 INFO:teuthology.orchestra.run.smithi027.stdout: 2022-07-21T20:44:01.432 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-21T20:44:01.432 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-21T20:44:01.432 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-21T20:44:01.433 INFO:teuthology.orchestra.run.smithi027.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-21T20:44:01.435 INFO:teuthology.lock.ops:Updating smithi027.front.sepia.ceph.com on lock server 2022-07-21T20:44:01.458 INFO:teuthology.lock.ops:Updating [smithi062.front.sepia.ceph.com]: set os type and version on server 2022-07-21T20:44:01.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2022-07-21T20:44:01.760 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2022-07-21T20:44:01.822 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Red Hat Enterprise Linux" 2022-07-21T20:44:01.823 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8.6 (Ootpa)" 2022-07-21T20:44:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:ID="rhel" 2022-07-21T20:44:01.824 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="fedora" 2022-07-21T20:44:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8.6" 2022-07-21T20:44:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2022-07-21T20:44:01.825 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-21T20:44:01.826 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2022-07-21T20:44:01.826 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-21T20:44:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.redhat.com/" 2022-07-21T20:44:01.828 INFO:teuthology.orchestra.run.smithi062.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-21T20:44:01.829 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-21T20:44:01.829 INFO:teuthology.orchestra.run.smithi062.stdout: 2022-07-21T20:44:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-21T20:44:01.830 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-21T20:44:01.831 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-21T20:44:01.831 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-21T20:44:01.833 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2022-07-21T20:44:01.869 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server 2022-07-21T20:44:01.870 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com' 2022-07-21T20:44:02.151 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64 2022-07-21T20:44:02.216 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux" 2022-07-21T20:44:02.217 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.6 (Ootpa)" 2022-07-21T20:44:02.217 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel" 2022-07-21T20:44:02.218 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora" 2022-07-21T20:44:02.219 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.6" 2022-07-21T20:44:02.219 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8" 2022-07-21T20:44:02.220 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-21T20:44:02.220 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31" 2022-07-21T20:44:02.220 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-21T20:44:02.221 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/" 2022-07-21T20:44:02.221 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-21T20:44:02.222 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-21T20:44:02.222 INFO:teuthology.orchestra.run.smithi123.stdout: 2022-07-21T20:44:02.223 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-21T20:44:02.223 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-21T20:44:02.224 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-21T20:44:02.224 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-21T20:44:02.225 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server 2022-07-21T20:44:02.362 INFO:teuthology.dispatcher.supervisor:Running job 6942675 2022-07-21T20:44:02.362 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_360d4be961a626c634e22ed40e864df998f28242/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2022-07-21_14:41:53-fs:workload-wip-pdonnell-testing-20220719.005446-distro-default-smithi/6942675 --name pdonnell-2022-07-21_14:41:53-fs:workload-wip-pdonnell-testing-20220719.005446-distro-default-smithi --description fs:workload/{0-centos_8.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/no 3-snaps/yes 4-workunit/db/postgres}} -- /home/teuthworker/archive/pdonnell-2022-07-21_14:41:53-fs:workload-wip-pdonnell-testing-20220719.005446-distro-default-smithi/6942675/orig.config.yaml 2022-07-21T20:44:02.367 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2022-07-21_14:41:53-fs:workload-wip-pdonnell-testing-20220719.005446-distro-default-smithi/6942675 2022-07-21T20:44:02.368 INFO:teuthology.dispatcher.supervisor:Job PID: 29270 2022-07-21T20:44:02.368 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-21T21:38:04.391 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-21T21:38:04.579 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi062 but it was locked by another job: /home/teuthworker/archive/dgalloway-2022-07-21_20:58:54-rgw-pacific-distro-default-smithi/6943150