2023-01-14T21:38:32.379 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-14T21:38:32.501 INFO:teuthology.lock.ops:Start node 'smithi146.front.sepia.ceph.com' reimaging 2023-01-14T21:38:32.502 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: reset os type and version on server 2023-01-14T21:38:32.502 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-01-14T21:38:32.519 INFO:teuthology.lock.ops:Node 'smithi146.front.sepia.ceph.com' reimaging is complete 2023-01-14T21:38:32.519 INFO:teuthology.lock.ops:Start node 'smithi167.front.sepia.ceph.com' reimaging 2023-01-14T21:38:32.520 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: reset os type and version on server 2023-01-14T21:38:32.520 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-01-14T21:38:32.534 INFO:teuthology.lock.ops:Node 'smithi167.front.sepia.ceph.com' reimaging is complete 2023-01-14T21:38:32.684 INFO:teuthology.provision.fog.smithi167:Scheduling deploy of rhel 8.4 2023-01-14T21:38:32.693 INFO:teuthology.provision.fog.smithi146:Scheduling deploy of rhel 8.4 2023-01-14T21:38:32.926 INFO:teuthology.orchestra.console:Power off smithi167 2023-01-14T21:38:32.940 INFO:teuthology.orchestra.console:Power off smithi146 2023-01-14T21:38:41.295 INFO:teuthology.orchestra.console:Power off for smithi167 completed 2023-01-14T21:38:41.396 INFO:teuthology.orchestra.console:Power on smithi167 2023-01-14T21:38:45.414 INFO:teuthology.orchestra.console:Power off for smithi146 completed 2023-01-14T21:38:45.516 INFO:teuthology.orchestra.console:Power on smithi146 2023-01-14T21:38:49.762 INFO:teuthology.orchestra.console:Power on for smithi167 completed 2023-01-14T21:38:49.863 INFO:teuthology.provision.fog.smithi167:Waiting for deploy to finish 2023-01-14T21:38:53.883 INFO:teuthology.orchestra.console:Power on for smithi146 completed 2023-01-14T21:38:53.984 INFO:teuthology.provision.fog.smithi146:Waiting for deploy to finish 2023-01-14T21:41:53.996 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:41:58.092 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:42:03.052 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:42:07.148 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:42:12.108 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:42:16.204 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:42:21.164 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:42:25.260 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:42:30.220 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:42:34.316 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:42:39.276 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.167 2023-01-14T21:42:43.372 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-01-14T21:43:16.989 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-14T21:43:41.840 INFO:teuthology.provision.fog.smithi167:Node is ready 2023-01-14T21:43:41.856 INFO:teuthology.orchestra.run.smithi167.stdout:smithi167.front.sepia.ceph.com 2023-01-14T21:43:41.910 INFO:teuthology.orchestra.run.smithi167.stdout:172.21.15.167 smithi167.front.sepia.ceph.com smithi167 2023-01-14T21:43:42.308 INFO:teuthology.provision.fog.smithi167:Deploy complete! 2023-01-14T21:43:49.384 WARNING:teuthology.provision.fog:timed out 2023-01-14T21:43:55.553 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-14T21:43:55.817 INFO:teuthology.provision.fog.smithi146:Node is ready 2023-01-14T21:43:55.874 INFO:teuthology.orchestra.run.smithi146.stdout:smithi146.front.sepia.ceph.com 2023-01-14T21:43:55.930 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.15.146 smithi146.front.sepia.ceph.com smithi146 2023-01-14T21:43:56.254 INFO:teuthology.provision.fog.smithi146:Deploy complete! 2023-01-14T21:43:56.433 INFO:teuthology.lock.ops:Checking smithi146.front.sepia.ceph.com 2023-01-14T21:43:56.434 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-14T21:43:56.452 INFO:teuthology.lock.ops:Checking smithi167.front.sepia.ceph.com 2023-01-14T21:43:56.452 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-14T21:43:56.466 INFO:teuthology.lock.ops:Updating [smithi146.front.sepia.ceph.com]: set os type and version on server 2023-01-14T21:43:56.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-01-14T21:43:56.647 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-01-14T21:43:56.701 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-01-14T21:43:56.702 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.4 (Ootpa)" 2023-01-14T21:43:56.702 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-01-14T21:43:56.702 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-01-14T21:43:56.702 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.4" 2023-01-14T21:43:56.702 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-01-14T21:43:56.703 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-01-14T21:43:56.703 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-01-14T21:43:56.703 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-01-14T21:43:56.703 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-01-14T21:43:56.703 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-14T21:43:56.704 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-14T21:43:56.704 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-01-14T21:43:56.704 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-14T21:43:56.704 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-01-14T21:43:56.704 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-14T21:43:56.705 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-01-14T21:43:56.706 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-01-14T21:43:56.721 INFO:teuthology.lock.ops:Updating [smithi167.front.sepia.ceph.com]: set os type and version on server 2023-01-14T21:43:56.721 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2023-01-14T21:43:56.961 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2023-01-14T21:43:57.015 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="Red Hat Enterprise Linux" 2023-01-14T21:43:57.016 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="8.4 (Ootpa)" 2023-01-14T21:43:57.016 INFO:teuthology.orchestra.run.smithi167.stdout:ID="rhel" 2023-01-14T21:43:57.016 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="fedora" 2023-01-14T21:43:57.016 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="8.4" 2023-01-14T21:43:57.016 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el8" 2023-01-14T21:43:57.017 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-01-14T21:43:57.017 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2023-01-14T21:43:57.017 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-01-14T21:43:57.017 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://www.redhat.com/" 2023-01-14T21:43:57.017 INFO:teuthology.orchestra.run.smithi167.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-01-14T21:43:57.018 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-14T21:43:57.018 INFO:teuthology.orchestra.run.smithi167.stdout: 2023-01-14T21:43:57.018 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-14T21:43:57.018 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-01-14T21:43:57.018 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-01-14T21:43:57.019 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-01-14T21:43:57.019 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2023-01-14T21:43:57.110 INFO:teuthology.dispatcher.supervisor:Running job 7142371 2023-01-14T21:43:57.110 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142371 --name yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi --description fs/multifs/{begin clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/failover} -- /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142371/orig.config.yaml 2023-01-14T21:43:57.115 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142371 2023-01-14T21:43:57.115 INFO:teuthology.dispatcher.supervisor:Job PID: 18321 2023-01-14T21:43:57.116 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-01-15T09:44:47.168 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-01-15T09:44:47.518 INFO:teuthology.kill:Killing Pids: {18321} 2023-01-15T09:44:49.278 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']