2022-05-24T08:46:58.242 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-24T08:46:58.375 INFO:teuthology.lock.ops:Start node 'smithi116.front.sepia.ceph.com' reimaging 2022-05-24T08:46:58.376 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: reset os type and version on server 2022-05-24T08:46:58.376 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-24T08:46:58.396 INFO:teuthology.lock.ops:Node 'smithi116.front.sepia.ceph.com' reimaging is complete 2022-05-24T08:46:58.398 INFO:teuthology.lock.ops:Start node 'smithi154.front.sepia.ceph.com' reimaging 2022-05-24T08:46:58.398 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: reset os type and version on server 2022-05-24T08:46:58.399 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-05-24T08:46:58.420 INFO:teuthology.lock.ops:Node 'smithi154.front.sepia.ceph.com' reimaging is complete 2022-05-24T08:46:58.631 INFO:teuthology.provision.fog.smithi154:Scheduling deploy of rhel 8.5 2022-05-24T08:46:58.635 INFO:teuthology.provision.fog.smithi116:Scheduling deploy of rhel 8.5 2022-05-24T08:46:59.020 INFO:teuthology.orchestra.console:Power off smithi154 2022-05-24T08:46:59.036 INFO:teuthology.orchestra.console:Power off smithi116 2022-05-24T08:47:11.525 INFO:teuthology.orchestra.console:Power off for smithi154 completed 2022-05-24T08:47:11.534 INFO:teuthology.orchestra.console:Power off for smithi116 completed 2022-05-24T08:47:11.627 INFO:teuthology.orchestra.console:Power on smithi154 2022-05-24T08:47:11.635 INFO:teuthology.orchestra.console:Power on smithi116 2022-05-24T08:47:15.892 INFO:teuthology.orchestra.console:Power on for smithi116 completed 2022-05-24T08:47:15.994 INFO:teuthology.provision.fog.smithi116:Waiting for deploy to finish 2022-05-24T08:47:19.995 INFO:teuthology.orchestra.console:Power on for smithi154 completed 2022-05-24T08:47:20.097 INFO:teuthology.provision.fog.smithi154:Waiting for deploy to finish 2022-05-24T08:52:02.898 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-24T08:52:03.152 INFO:teuthology.provision.fog.smithi116:Node is ready 2022-05-24T08:52:03.174 INFO:teuthology.orchestra.run.smithi116.stdout:smithi116.front.sepia.ceph.com 2022-05-24T08:52:03.231 INFO:teuthology.orchestra.run.smithi116.stdout:172.21.15.116 smithi116.front.sepia.ceph.com smithi116 2022-05-24T08:52:03.577 INFO:teuthology.provision.fog.smithi116:Deploy complete! 2022-05-24T08:52:15.992 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-24T08:52:16.225 INFO:teuthology.provision.fog.smithi154:Node is ready 2022-05-24T08:52:16.242 INFO:teuthology.orchestra.run.smithi154.stdout:smithi154.front.sepia.ceph.com 2022-05-24T08:52:16.299 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.15.154 smithi154.front.sepia.ceph.com smithi154 2022-05-24T08:52:16.654 INFO:teuthology.provision.fog.smithi154:Deploy complete! 2022-05-24T08:52:16.825 INFO:teuthology.lock.ops:Checking smithi116.front.sepia.ceph.com 2022-05-24T08:52:16.826 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-24T08:52:16.848 INFO:teuthology.lock.ops:Checking smithi154.front.sepia.ceph.com 2022-05-24T08:52:16.848 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-24T08:52:16.872 INFO:teuthology.lock.ops:Updating [smithi116.front.sepia.ceph.com]: set os type and version on server 2022-05-24T08:52:16.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-24T08:52:17.131 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2022-05-24T08:52:17.188 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2022-05-24T08:52:17.188 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.5 (Ootpa)" 2022-05-24T08:52:17.189 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2022-05-24T08:52:17.189 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2022-05-24T08:52:17.189 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.5" 2022-05-24T08:52:17.189 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2022-05-24T08:52:17.190 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-24T08:52:17.190 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2022-05-24T08:52:17.190 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-24T08:52:17.190 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2022-05-24T08:52:17.191 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-24T08:52:17.191 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-24T08:52:17.191 INFO:teuthology.orchestra.run.smithi116.stdout: 2022-05-24T08:52:17.191 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-24T08:52:17.192 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-24T08:52:17.192 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-24T08:52:17.192 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-24T08:52:17.194 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2022-05-24T08:52:17.220 INFO:teuthology.lock.ops:Updating [smithi154.front.sepia.ceph.com]: set os type and version on server 2022-05-24T08:52:17.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-05-24T08:52:17.424 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2022-05-24T08:52:17.480 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2022-05-24T08:52:17.481 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.5 (Ootpa)" 2022-05-24T08:52:17.481 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2022-05-24T08:52:17.481 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2022-05-24T08:52:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.5" 2022-05-24T08:52:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2022-05-24T08:52:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)" 2022-05-24T08:52:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2022-05-24T08:52:17.482 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-05-24T08:52:17.483 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2022-05-24T08:52:17.483 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-05-24T08:52:17.483 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-24T08:52:17.483 INFO:teuthology.orchestra.run.smithi154.stdout: 2022-05-24T08:52:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-24T08:52:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.5 2022-05-24T08:52:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-05-24T08:52:17.484 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.5" 2022-05-24T08:52:17.485 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2022-05-24T08:52:17.599 INFO:teuthology.dispatcher.supervisor:Running job 6847294 2022-05-24T08:52:17.599 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_dparmar@teuthology --archive /home/teuthworker/archive/dparmar-2022-05-24_08:44:13-fs-master-distro-default-smithi/6847294 --name dparmar-2022-05-24_08:44:13-fs-master-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{no_client_pidfile whitelist_health whitelist_wrongly_marked_down} tasks/client-readahead} -- /home/teuthworker/archive/dparmar-2022-05-24_08:44:13-fs-master-distro-default-smithi/6847294/orig.config.yaml 2022-05-24T08:52:17.604 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/dparmar-2022-05-24_08:44:13-fs-master-distro-default-smithi/6847294 2022-05-24T08:52:17.605 INFO:teuthology.dispatcher.supervisor:Job PID: 2738 2022-05-24T08:52:17.606 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-24T15:22:48.950 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-24T15:22:49.376 INFO:teuthology.kill:Killing Pids: {2738} 2022-05-24T15:22:50.733 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-05-24T15:22:50.734 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-05-24T15:22:50.734 INFO:teuthology.misc:Compressing logs... 2022-05-24T15:22:50.735 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2022-05-24T15:22:51.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2022-05-24T15:22:51.198 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-24T15:22:51.413 INFO:teuthology.orchestra.run.smithi154.stderr:find: ‘/home/ubuntu/cephtest/archive’: No such file or directory 2022-05-24T15:22:51.441 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-24T15:22:51.441 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2022-05-24T15:22:51.467 INFO:teuthology.orchestra.run.smithi154.stderr:tar: /home/ubuntu/cephtest/archive: Cannot open: No such file or directory 2022-05-24T15:22:51.467 INFO:teuthology.orchestra.run.smithi154.stderr:tar: Error is not recoverable: exiting now 2022-05-24T15:22:51.527 INFO:teuthology.kill:No teuthology processes running 2022-05-24T15:22:52.745 INFO:teuthology.kill:No locked machines. Not nuking anything 2022-05-24T15:24:52.879 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15