2022-01-27T21:00:09.234 INFO:root:teuthology version: 1.1.0-7c0cb867 2022-01-27T21:00:09.394 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging 2022-01-27T21:00:09.395 INFO:teuthology.lock.ops:Updating [ubuntu@smithi033.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T21:00:09.396 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-01-27T21:00:09.448 INFO:teuthology.lock.ops:Node 'ubuntu@smithi033.front.sepia.ceph.com' reimaging is complete 2022-01-27T21:00:09.448 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging 2022-01-27T21:00:09.448 INFO:teuthology.lock.ops:Updating [ubuntu@smithi068.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T21:00:09.449 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2022-01-27T21:00:09.466 INFO:teuthology.lock.ops:Node 'ubuntu@smithi068.front.sepia.ceph.com' reimaging is complete 2022-01-27T21:00:09.467 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging 2022-01-27T21:00:09.467 INFO:teuthology.lock.ops:Updating [ubuntu@smithi083.front.sepia.ceph.com]: reset os type and version on server 2022-01-27T21:00:09.467 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-01-27T21:00:09.485 INFO:teuthology.lock.ops:Node 'ubuntu@smithi083.front.sepia.ceph.com' reimaging is complete 2022-01-27T21:00:09.668 INFO:teuthology.provision.fog.smithi033:Scheduling deploy of rhel 8.4 2022-01-27T21:00:09.686 INFO:teuthology.provision.fog.smithi068:Scheduling deploy of rhel 8.4 2022-01-27T21:00:09.700 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of rhel 8.4 2022-01-27T21:00:10.088 INFO:teuthology.orchestra.console:Power off smithi033 2022-01-27T21:00:10.109 INFO:teuthology.orchestra.console:Power off smithi068 2022-01-27T21:00:10.146 INFO:teuthology.orchestra.console:Power off smithi083 2022-01-27T21:00:10.255 INFO:teuthology.orchestra.console:Power off for smithi068 completed 2022-01-27T21:00:10.255 INFO:teuthology.orchestra.console:Power off for smithi033 completed 2022-01-27T21:00:10.285 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-01-27T21:00:10.356 INFO:teuthology.orchestra.console:Power on smithi068 2022-01-27T21:00:10.364 INFO:teuthology.orchestra.console:Power on smithi033 2022-01-27T21:00:10.387 INFO:teuthology.orchestra.console:Power on smithi083 2022-01-27T21:00:14.624 INFO:teuthology.orchestra.console:Power on for smithi033 completed 2022-01-27T21:00:14.637 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2022-01-27T21:00:14.726 INFO:teuthology.provision.fog.smithi033:Waiting for deploy to finish 2022-01-27T21:00:14.738 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2022-01-27T21:00:18.739 INFO:teuthology.orchestra.console:Power on for smithi068 completed 2022-01-27T21:00:18.840 INFO:teuthology.provision.fog.smithi068:Waiting for deploy to finish 2022-01-27T21:02:31.315 ERROR:teuthology.orchestra.connection:Error authenticating with smithi033.front.sepia.ceph.com: Authentication failed. 2022-01-27T21:04:05.717 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T21:04:16.900 INFO:teuthology.provision.fog.smithi033:Node is ready 2022-01-27T21:04:16.921 INFO:teuthology.orchestra.run.smithi033.stdout:smithi033.front.sepia.ceph.com 2022-01-27T21:04:16.978 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.15.33 smithi033.front.sepia.ceph.com smithi033 2022-01-27T21:04:17.330 INFO:teuthology.provision.fog.smithi033:Deploy complete! 2022-01-27T21:04:47.034 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T21:04:47.244 INFO:teuthology.provision.fog.smithi083:Node is ready 2022-01-27T21:04:47.259 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2022-01-27T21:04:47.315 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2022-01-27T21:04:47.664 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2022-01-27T21:05:02.663 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-01-27T21:05:02.728 INFO:teuthology.provision.fog.smithi068:Node is ready 2022-01-27T21:05:02.784 INFO:teuthology.orchestra.run.smithi068.stdout:smithi068.front.sepia.ceph.com 2022-01-27T21:05:02.839 INFO:teuthology.orchestra.run.smithi068.stdout:172.21.15.68 smithi068.front.sepia.ceph.com smithi068 2022-01-27T21:05:03.164 INFO:teuthology.provision.fog.smithi068:Deploy complete! 2022-01-27T21:05:03.354 INFO:teuthology.lock.ops:Checking smithi033.front.sepia.ceph.com 2022-01-27T21:05:03.355 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-27T21:05:03.378 INFO:teuthology.lock.ops:Checking smithi068.front.sepia.ceph.com 2022-01-27T21:05:03.379 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-27T21:05:03.396 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2022-01-27T21:05:03.396 INFO:teuthology.lock.ops:New key found. Updating... 2022-01-27T21:05:03.415 INFO:teuthology.lock.ops:Updating [smithi033.front.sepia.ceph.com]: set os type and version on server 2022-01-27T21:05:03.416 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2022-01-27T21:05:03.663 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2022-01-27T21:05:03.720 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2022-01-27T21:05:03.721 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2022-01-27T21:05:03.721 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2022-01-27T21:05:03.722 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2022-01-27T21:05:03.722 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2022-01-27T21:05:03.723 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2022-01-27T21:05:03.723 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-27T21:05:03.724 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2022-01-27T21:05:03.724 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-27T21:05:03.725 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2022-01-27T21:05:03.725 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-27T21:05:03.726 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-27T21:05:03.726 INFO:teuthology.orchestra.run.smithi033.stdout: 2022-01-27T21:05:03.726 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-27T21:05:03.726 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-27T21:05:03.727 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-27T21:05:03.727 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-27T21:05:03.728 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2022-01-27T21:05:03.770 INFO:teuthology.lock.ops:Updating [smithi068.front.sepia.ceph.com]: set os type and version on server 2022-01-27T21:05:03.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi068.front.sepia.ceph.com' 2022-01-27T21:05:03.952 INFO:teuthology.orchestra.run.smithi068.stdout:x86_64 2022-01-27T21:05:04.008 INFO:teuthology.orchestra.run.smithi068.stdout:NAME="Red Hat Enterprise Linux" 2022-01-27T21:05:04.008 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION="8.4 (Ootpa)" 2022-01-27T21:05:04.008 INFO:teuthology.orchestra.run.smithi068.stdout:ID="rhel" 2022-01-27T21:05:04.009 INFO:teuthology.orchestra.run.smithi068.stdout:ID_LIKE="fedora" 2022-01-27T21:05:04.009 INFO:teuthology.orchestra.run.smithi068.stdout:VERSION_ID="8.4" 2022-01-27T21:05:04.009 INFO:teuthology.orchestra.run.smithi068.stdout:PLATFORM_ID="platform:el8" 2022-01-27T21:05:04.009 INFO:teuthology.orchestra.run.smithi068.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-27T21:05:04.010 INFO:teuthology.orchestra.run.smithi068.stdout:ANSI_COLOR="0;31" 2022-01-27T21:05:04.010 INFO:teuthology.orchestra.run.smithi068.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-27T21:05:04.010 INFO:teuthology.orchestra.run.smithi068.stdout:HOME_URL="https://www.redhat.com/" 2022-01-27T21:05:04.010 INFO:teuthology.orchestra.run.smithi068.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-27T21:05:04.010 INFO:teuthology.orchestra.run.smithi068.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-27T21:05:04.011 INFO:teuthology.orchestra.run.smithi068.stdout: 2022-01-27T21:05:04.011 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-27T21:05:04.011 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-27T21:05:04.011 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-27T21:05:04.012 INFO:teuthology.orchestra.run.smithi068.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-27T21:05:04.012 INFO:teuthology.lock.ops:Updating smithi068.front.sepia.ceph.com on lock server 2022-01-27T21:05:04.032 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2022-01-27T21:05:04.033 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-01-27T21:05:04.266 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2022-01-27T21:05:04.322 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Red Hat Enterprise Linux" 2022-01-27T21:05:04.323 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="8.4 (Ootpa)" 2022-01-27T21:05:04.323 INFO:teuthology.orchestra.run.smithi083.stdout:ID="rhel" 2022-01-27T21:05:04.323 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE="fedora" 2022-01-27T21:05:04.324 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="8.4" 2022-01-27T21:05:04.324 INFO:teuthology.orchestra.run.smithi083.stdout:PLATFORM_ID="platform:el8" 2022-01-27T21:05:04.325 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-01-27T21:05:04.325 INFO:teuthology.orchestra.run.smithi083.stdout:ANSI_COLOR="0;31" 2022-01-27T21:05:04.325 INFO:teuthology.orchestra.run.smithi083.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-01-27T21:05:04.326 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.redhat.com/" 2022-01-27T21:05:04.326 INFO:teuthology.orchestra.run.smithi083.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-01-27T21:05:04.327 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-01-27T21:05:04.327 INFO:teuthology.orchestra.run.smithi083.stdout: 2022-01-27T21:05:04.327 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-01-27T21:05:04.328 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-01-27T21:05:04.328 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-01-27T21:05:04.328 INFO:teuthology.orchestra.run.smithi083.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-01-27T21:05:04.329 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-01-27T21:05:04.432 INFO:teuthology.dispatcher.supervisor:Running job 6644649 2022-01-27T21:05:04.432 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_7c0cb8672986d9dbe53078a123af65593653ef7a/virtualenv/bin/teuthology -v --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2022-01-27_20:30:21-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644649 --name pdonnell-2022-01-27_20:30:21-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi --description fs:workload/{begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse ms_mode/{crc} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{frag osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} ranks/3 rhel_8 scrub/yes standby-replay tasks/{0-check-counter workunit/fs/misc} wsync/{yes}} -- /home/teuthworker/archive/pdonnell-2022-01-27_20:30:21-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644649/orig.config.yaml 2022-01-27T21:05:04.436 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/pdonnell-2022-01-27_20:30:21-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644649 2022-01-27T21:05:04.436 INFO:teuthology.dispatcher.supervisor:Job PID: 19009 2022-01-27T21:05:04.437 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-01-27T21:11:04.614 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-01-27T21:11:04.756 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi033 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-01-27_21:09:29-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644751 2022-01-27T21:11:04.756 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi068 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-01-27_21:09:29-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644739 2022-01-27T21:11:04.757 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-01-27_21:09:29-fs:workload-wip-pdonnell-testing-20220127.171526-distro-default-smithi/6644755