2022-08-09T07:02:20.668 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f 2022-08-09T07:02:20.883 INFO:teuthology.lock.ops:Start node 'smithi084.front.sepia.ceph.com' reimaging 2022-08-09T07:02:20.884 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: reset os type and version on server 2022-08-09T07:02:20.885 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2022-08-09T07:02:20.926 INFO:teuthology.lock.ops:Node 'smithi084.front.sepia.ceph.com' reimaging is complete 2022-08-09T07:02:20.927 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2022-08-09T07:02:20.928 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-08-09T07:02:20.929 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-08-09T07:02:20.959 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete 2022-08-09T07:02:21.172 INFO:teuthology.provision.fog.smithi084:Scheduling deploy of rhel 8.4 2022-08-09T07:02:21.200 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of rhel 8.4 2022-08-09T07:02:21.511 INFO:teuthology.orchestra.console:Power off smithi084 2022-08-09T07:02:21.574 INFO:teuthology.orchestra.console:Power off smithi133 2022-08-09T07:02:29.943 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2022-08-09T07:02:30.049 INFO:teuthology.orchestra.console:Power on smithi084 2022-08-09T07:02:34.096 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-08-09T07:02:34.199 INFO:teuthology.orchestra.console:Power on smithi133 2022-08-09T07:02:38.472 INFO:teuthology.orchestra.console:Power on for smithi084 completed 2022-08-09T07:02:38.482 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-08-09T07:02:38.574 INFO:teuthology.provision.fog.smithi084:Waiting for deploy to finish 2022-08-09T07:02:38.583 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-08-09T07:07:10.615 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-09T07:07:10.799 INFO:teuthology.provision.fog.smithi084:Node is ready 2022-08-09T07:07:10.820 INFO:teuthology.orchestra.run.smithi084.stdout:smithi084.front.sepia.ceph.com 2022-08-09T07:07:10.878 INFO:teuthology.orchestra.run.smithi084.stdout:172.21.15.84 smithi084.front.sepia.ceph.com smithi084 2022-08-09T07:07:11.251 INFO:teuthology.provision.fog.smithi084:Deploy complete! 2022-08-09T07:07:25.677 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-09T07:07:25.909 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-08-09T07:07:25.932 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2022-08-09T07:07:25.991 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-08-09T07:07:26.354 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-08-09T07:07:26.596 INFO:teuthology.lock.ops:Checking smithi084.front.sepia.ceph.com 2022-08-09T07:07:26.598 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-09T07:07:26.625 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-08-09T07:07:26.626 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-09T07:07:26.651 INFO:teuthology.lock.ops:Updating [smithi084.front.sepia.ceph.com]: set os type and version on server 2022-08-09T07:07:26.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2022-08-09T07:07:26.986 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2022-08-09T07:07:27.042 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="Red Hat Enterprise Linux" 2022-08-09T07:07:27.043 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="8.4 (Ootpa)" 2022-08-09T07:07:27.043 INFO:teuthology.orchestra.run.smithi084.stdout:ID="rhel" 2022-08-09T07:07:27.044 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="fedora" 2022-08-09T07:07:27.044 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="8.4" 2022-08-09T07:07:27.044 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el8" 2022-08-09T07:07:27.045 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-08-09T07:07:27.045 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2022-08-09T07:07:27.046 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-08-09T07:07:27.046 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://www.redhat.com/" 2022-08-09T07:07:27.046 INFO:teuthology.orchestra.run.smithi084.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-09T07:07:27.047 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-09T07:07:27.047 INFO:teuthology.orchestra.run.smithi084.stdout: 2022-08-09T07:07:27.048 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-09T07:07:27.048 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-08-09T07:07:27.049 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-09T07:07:27.049 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-08-09T07:07:27.051 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2022-08-09T07:07:27.073 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-08-09T07:07:27.073 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-08-09T07:07:27.331 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-08-09T07:07:27.386 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Red Hat Enterprise Linux" 2022-08-09T07:07:27.387 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8.4 (Ootpa)" 2022-08-09T07:07:27.387 INFO:teuthology.orchestra.run.smithi133.stdout:ID="rhel" 2022-08-09T07:07:27.387 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="fedora" 2022-08-09T07:07:27.388 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8.4" 2022-08-09T07:07:27.389 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2022-08-09T07:07:27.389 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2022-08-09T07:07:27.389 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2022-08-09T07:07:27.389 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2022-08-09T07:07:27.390 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.redhat.com/" 2022-08-09T07:07:27.393 INFO:teuthology.orchestra.run.smithi133.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-08-09T07:07:27.394 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-09T07:07:27.394 INFO:teuthology.orchestra.run.smithi133.stdout: 2022-08-09T07:07:27.394 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-09T07:07:27.394 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2022-08-09T07:07:27.395 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-08-09T07:07:27.395 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2022-08-09T07:07:27.396 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-08-09T07:07:27.510 INFO:teuthology.dispatcher.supervisor:Running job 6962637 2022-08-09T07:07:27.510 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-08-08_23:16:20-fs-wip-yuri11-testing-2022-08-08-0815-quincy-distro-default-smithi/6962637 --name yuriw-2022-08-08_23:16:20-fs-wip-yuri11-testing-2022-08-08-0815-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2022-08-08_23:16:20-fs-wip-yuri11-testing-2022-08-08-0815-quincy-distro-default-smithi/6962637/orig.config.yaml 2022-08-09T07:07:27.515 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-08-08_23:16:20-fs-wip-yuri11-testing-2022-08-08-0815-quincy-distro-default-smithi/6962637 2022-08-09T07:07:27.516 INFO:teuthology.dispatcher.supervisor:Job PID: 2684 2022-08-09T07:07:27.516 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-08-09T19:08:29.163 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-08-09T19:08:29.401 INFO:teuthology.kill:Killing Pids: {2684} 2022-08-09T19:08:31.238 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-08-09T19:08:31.240 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2022-08-09T19:08:31.241 INFO:teuthology.misc:Compressing logs... 2022-08-09T19:08:31.242 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2022-08-09T19:08:31.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-08-09T19:08:32.265 INFO:teuthology.misc:Compressing logs... 2022-08-09T19:08:35.521 INFO:teuthology.misc:Compressing logs... 2022-08-09T19:19:20.277 INFO:teuthology.kill:No teuthology processes running 2022-08-09T19:19:22.013 INFO:teuthology.kill:Nuking machines: ['smithi084', 'smithi133'] 2022-08-09T19:19:23.418 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-08-09T19:19:23.420 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-08-09T19:19:23.421 INFO:teuthology.kill:2022-08-09 19:19:23,418.418 INFO:teuthology.nuke:targets: 2022-08-09T19:19:23.422 INFO:teuthology.kill: smithi084.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCeazTx7+QAi6C/726mqpEkRoSYUoSCEj+urlRzmCuLIEBa+87rMe3qHoY8S0K1Yw1sKpS7+uZqLoPVCHkoziPYsigEz3HykaKp7s74A2+GWhKbC7s8k4DM5t2dhW+34PQGT+/S2jkz94qfOnXezvPW9rWluma6Ek2l/mdtLqVhun3ukfRaDgw6kLu2Os3UmCKfb1XNrbti9KMTelr5t66Qb6mIZf/5iAoTou8o30mOL0C8j39L+4862EVoNVCh1DDIFMZceJZbrGEmEpTS7a07Eqg2EgRL/8vj1Tl4suZU6ieaqE8Rh9DObRJxWOdeIUnNuNP1onWBcqEpuWQXCpADVKt0hqnrdUoJwOE5fe2GwWcHl1rZtG9SCr15sYVmrgOLkIt5WyMtrYwv0/w1b7GUim48+xPPiwgti/3j789kDrcgpOXsReCxrIslqM87wCmn7EoVlpANi5rW2DLQWSNyNiK6LG747I4djwN4LAPWvIt3OtRl0aTGBM6eMicaV18= 2022-08-09T19:19:23.422 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCy2dsbmNMDyzgaPOG7kS8Ei4TNnbBG+rSkP6DPemLyMUaj7AGNJb+qoOwFasH7bUWKzKIoWPyRof6PgiJz8A66FcObLXD95heXBdNrccw14013fJMlWO42yZGZHEl2SjWVAIVTzPPrV5+he9MqI4LXeq+udJNAEufw59gszgZ+SqDPG0j/oPpfucrOaeE3qAPf+anJQuJmw0mQRDE+YkIE5q/yemt8pA1EnZq5DKY58GZ47D/n0MWh9Nkl7dw9RMpbyVZKA0Jojao76HOHH+7CewyMtDgdmHCoUyyxok+nOHlcfuWdZ9xHOEy8jA2B9f2zvs+Vvwvmfq+5vu4SEcqIZMUOyfvqXb9vF/fw+YQi8yFvSE5sG6epq0IezeGjHzoYfc2+ne2d9Y0ClSTcLPVNw3avq+p8SVeNKXXwG0ioh/5BVawPhE+X8EvlR2noulZ4RlNfYqN2Ejr6nb0e/NZyuadPMB9Ej6M3cBdVabuxa3AuRJEDrEUVW3lXHoQzEkk= 2022-08-09T19:19:23.423 INFO:teuthology.kill:2022-08-09 19:19:23,418.418 INFO:teuthology.nuke:Checking targets against current locks 2022-08-09T19:19:23.484 INFO:teuthology.kill:2022-08-09 19:19:23,484.484 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-09T19:19:23.528 INFO:teuthology.kill:2022-08-09 19:19:23,527.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-09T19:19:23.596 INFO:teuthology.kill:2022-08-09 19:19:23,596.596 INFO:teuthology.orchestra.console:Power off smithi084 2022-08-09T19:19:23.662 INFO:teuthology.kill:2022-08-09 19:19:23,661.661 INFO:teuthology.orchestra.console:Power off smithi133 2022-08-09T19:19:32.012 INFO:teuthology.kill:2022-08-09 19:19:32,011.011 INFO:teuthology.orchestra.console:Power off for smithi084 completed 2022-08-09T19:19:32.178 INFO:teuthology.kill:2022-08-09 19:19:32,177.177 INFO:teuthology.lock.ops:unlocked: smithi084.front.sepia.ceph.com 2022-08-09T19:19:36.174 INFO:teuthology.kill:2022-08-09 19:19:36,174.174 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-08-09T19:19:36.355 INFO:teuthology.kill:2022-08-09 19:19:36,355.355 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-08-09T19:21:36.770 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-08-09T19:21:36.986 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi084 but it was locked by another job: /home/teuthworker/archive/amaredia-2022-08-09_19:02:34-rgw:verify-wip-rgw-timeout-fail-check-7-11-22-distro-default-smithi/6964177 2022-08-09T19:21:36.986 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/amaredia-2022-08-09_19:02:34-rgw:verify-wip-rgw-timeout-fail-check-7-11-22-distro-default-smithi/6964178