2022-10-17T11:12:30.485 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-17T11:12:30.630 INFO:teuthology.lock.ops:Start node 'smithi050.front.sepia.ceph.com' reimaging 2022-10-17T11:12:30.631 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: reset os type and version on server 2022-10-17T11:12:30.632 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-10-17T11:12:30.653 INFO:teuthology.lock.ops:Node 'smithi050.front.sepia.ceph.com' reimaging is complete 2022-10-17T11:12:30.654 INFO:teuthology.lock.ops:Start node 'smithi115.front.sepia.ceph.com' reimaging 2022-10-17T11:12:30.654 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: reset os type and version on server 2022-10-17T11:12:30.655 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-10-17T11:12:30.675 INFO:teuthology.lock.ops:Node 'smithi115.front.sepia.ceph.com' reimaging is complete 2022-10-17T11:12:30.880 INFO:teuthology.provision.fog.smithi050:Scheduling deploy of centos 8.stream 2022-10-17T11:12:30.898 INFO:teuthology.provision.fog.smithi115:Scheduling deploy of centos 8.stream 2022-10-17T11:12:31.227 INFO:teuthology.orchestra.console:Power off smithi050 2022-10-17T11:12:31.269 INFO:teuthology.orchestra.console:Power off smithi115 2022-10-17T11:12:39.604 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-10-17T11:12:39.705 INFO:teuthology.orchestra.console:Power on smithi050 2022-10-17T11:12:43.748 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-10-17T11:12:43.850 INFO:teuthology.orchestra.console:Power on smithi115 2022-10-17T11:12:48.074 INFO:teuthology.orchestra.console:Power on for smithi050 completed 2022-10-17T11:12:48.104 INFO:teuthology.orchestra.console:Power on for smithi115 completed 2022-10-17T11:12:48.176 INFO:teuthology.provision.fog.smithi050:Waiting for deploy to finish 2022-10-17T11:12:48.205 INFO:teuthology.provision.fog.smithi115:Waiting for deploy to finish 2022-10-17T11:16:27.535 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-17T11:16:47.869 INFO:teuthology.provision.fog.smithi050:Node is ready 2022-10-17T11:16:47.892 INFO:teuthology.orchestra.run.smithi050.stdout:smithi050.front.sepia.ceph.com 2022-10-17T11:16:47.953 INFO:teuthology.orchestra.run.smithi050.stdout:172.21.15.50 smithi050.front.sepia.ceph.com smithi050 2022-10-17T11:16:48.324 INFO:teuthology.provision.fog.smithi050:Deploy complete! 2022-10-17T11:17:32.187 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-17T11:17:32.451 INFO:teuthology.provision.fog.smithi115:Node is ready 2022-10-17T11:17:32.470 INFO:teuthology.orchestra.run.smithi115.stdout:smithi115.front.sepia.ceph.com 2022-10-17T11:17:32.529 INFO:teuthology.orchestra.run.smithi115.stdout:172.21.15.115 smithi115.front.sepia.ceph.com smithi115 2022-10-17T11:17:32.872 INFO:teuthology.provision.fog.smithi115:Deploy complete! 2022-10-17T11:17:33.083 INFO:teuthology.lock.ops:Checking smithi050.front.sepia.ceph.com 2022-10-17T11:17:33.084 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-17T11:17:33.107 INFO:teuthology.lock.ops:Checking smithi115.front.sepia.ceph.com 2022-10-17T11:17:33.107 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-17T11:17:33.128 INFO:teuthology.lock.ops:Updating [smithi050.front.sepia.ceph.com]: set os type and version on server 2022-10-17T11:17:33.129 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-10-17T11:17:33.403 INFO:teuthology.orchestra.run.smithi050.stdout:x86_64 2022-10-17T11:17:33.462 INFO:teuthology.orchestra.run.smithi050.stdout:NAME="CentOS Stream" 2022-10-17T11:17:33.463 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION="8" 2022-10-17T11:17:33.463 INFO:teuthology.orchestra.run.smithi050.stdout:ID="centos" 2022-10-17T11:17:33.464 INFO:teuthology.orchestra.run.smithi050.stdout:ID_LIKE="rhel fedora" 2022-10-17T11:17:33.464 INFO:teuthology.orchestra.run.smithi050.stdout:VERSION_ID="8" 2022-10-17T11:17:33.465 INFO:teuthology.orchestra.run.smithi050.stdout:PLATFORM_ID="platform:el8" 2022-10-17T11:17:33.465 INFO:teuthology.orchestra.run.smithi050.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-17T11:17:33.466 INFO:teuthology.orchestra.run.smithi050.stdout:ANSI_COLOR="0;31" 2022-10-17T11:17:33.466 INFO:teuthology.orchestra.run.smithi050.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-17T11:17:33.467 INFO:teuthology.orchestra.run.smithi050.stdout:HOME_URL="https://centos.org/" 2022-10-17T11:17:33.467 INFO:teuthology.orchestra.run.smithi050.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-17T11:17:33.467 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-17T11:17:33.468 INFO:teuthology.orchestra.run.smithi050.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-17T11:17:33.470 INFO:teuthology.lock.ops:Updating smithi050.front.sepia.ceph.com on lock server 2022-10-17T11:17:33.489 INFO:teuthology.lock.ops:Updating [smithi115.front.sepia.ceph.com]: set os type and version on server 2022-10-17T11:17:33.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-10-17T11:17:33.686 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2022-10-17T11:17:33.744 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="CentOS Stream" 2022-10-17T11:17:33.744 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="8" 2022-10-17T11:17:33.745 INFO:teuthology.orchestra.run.smithi115.stdout:ID="centos" 2022-10-17T11:17:33.745 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE="rhel fedora" 2022-10-17T11:17:33.746 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="8" 2022-10-17T11:17:33.746 INFO:teuthology.orchestra.run.smithi115.stdout:PLATFORM_ID="platform:el8" 2022-10-17T11:17:33.747 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="CentOS Stream 8" 2022-10-17T11:17:33.747 INFO:teuthology.orchestra.run.smithi115.stdout:ANSI_COLOR="0;31" 2022-10-17T11:17:33.748 INFO:teuthology.orchestra.run.smithi115.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-10-17T11:17:33.748 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://centos.org/" 2022-10-17T11:17:33.749 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-10-17T11:17:33.749 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-10-17T11:17:33.749 INFO:teuthology.orchestra.run.smithi115.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-10-17T11:17:33.750 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2022-10-17T11:17:33.864 INFO:teuthology.dispatcher.supervisor:Running job 7069936 2022-10-17T11:17:33.865 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2022-10-17_08:01:45-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7069936 --name vshankar-2022-10-17_08:01:45-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/journal-repair} -- /home/teuthworker/archive/vshankar-2022-10-17_08:01:45-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7069936/orig.config.yaml 2022-10-17T11:17:33.870 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2022-10-17_08:01:45-fs-wip-vshankar-testing1-20221017-112130-testing-default-smithi/7069936 2022-10-17T11:17:33.870 INFO:teuthology.dispatcher.supervisor:Job PID: 23337 2022-10-17T11:17:33.871 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-17T23:18:29.543 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-17T23:18:29.738 INFO:teuthology.kill:Killing Pids: {23337} 2022-10-17T23:18:31.078 INFO:teuthology.task.internal:roles: ubuntu@smithi050.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-10-17T23:18:31.079 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-10-17T23:18:31.080 INFO:teuthology.misc:Compressing logs... 2022-10-17T23:18:31.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi050.front.sepia.ceph.com' 2022-10-17T23:18:31.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2022-10-17T23:18:31.885 INFO:teuthology.misc:Compressing logs... 2022-10-17T23:18:32.211 INFO:teuthology.misc:Compressing logs... 2022-10-17T23:20:48.335 INFO:teuthology.kill:No teuthology processes running 2022-10-17T23:20:49.682 INFO:teuthology.kill:Nuking machines: ['smithi050', 'smithi115'] 2022-10-17T23:20:50.831 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-17T23:20:50.832 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-17T23:20:50.832 INFO:teuthology.kill:2022-10-17 23:20:50,831.831 INFO:teuthology.nuke:targets: 2022-10-17T23:20:50.833 INFO:teuthology.kill: smithi050.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRz+lhik3maDbmBi0CNyMVzxuFcmumVqX7Z6KL28ISySual6S3qYIbB2HFATKcnMI7ha1MGtfwhvMB8y21pqWDA9erKNk48iCoYqgpO55Z+oyvpkFQpdqZLBWA+HGpS/MgJi+MtYtgAgxmT6x3qmqFdXSGadxiWQlTxzq3rlE6a2DdPRyzITYn0uuIA5BYwZmY97sCHRCLvPTwWnrsKg97A+Fcm73Dm7R10bSoQe7Y6xbdmXLGqkwLxutp9D0n3sEZbEe6YLED1QxW8yixyIU58IB26llcrxFfmQU8zcHklI1gAiKol3ITWxGrOxnUTJePAUBgv9tE5WJtVQEuI0xe8MGe/6h36L/+7gUPtUYp+CWLBTGkaeBGYjfQbipP7Su5y4bDi4RbV/UUw713qHt7HPJKU4xghMLw7WmsRKQN6uymAlZDp7FLiKyGdUlxgJg0+I5gXaRxKJqxGZw/RRoiN21OmpIVLQW4X4XktifhDnhY/CYqdSKzaHQEPGNX4uc= 2022-10-17T23:20:50.833 INFO:teuthology.kill: smithi115.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDUkMKgsWlcZoPr2Whmjhe7580bR0RmS62jeqjSIjRfjOfxC+f/NYuKRcywZ57eFDAy//YDcquHEEpG5P/D02/QkjFNDF5XBgE7w/o4zvv00wXqpB2JnZTHeikPGOaRWrvbicywEEermQBOzufw0Sj//8ikMVEZyNr7KMiaGId0FvWQblE6jQzOlJRJ9DSEEPeJWPaJ1gzWBwGATh8QU0lv45IRt3axC0vghHc5/cMzRzInqNlDUbZmKUtd0DXT12NstKZ0GpNAAacIjVw6FkYQGCUyduLKyxysyrtpz8KUw1HKSYXgqX2MEFp/D5KsZ9Fucvaolviu1DlKcZ4bNbz1i3UuNlqP1QILxRfFQvhZHEKgImO9QgB3u3vPIroettNTUOf+3Jn8AlS7sH10cxeDtvuzBqbtNugU2DSEymbnbdMJ/wGzNBd6b79fi/MUy4ZE/yCTJn8KxThk+Xg8R+jvVYVOhcTaEhVfKGAXd6tlY75Irk8ywWN9DcaIYS+P7N0= 2022-10-17T23:20:50.833 INFO:teuthology.kill:2022-10-17 23:20:50,831.831 INFO:teuthology.nuke:Checking targets against current locks 2022-10-17T23:20:50.889 INFO:teuthology.kill:2022-10-17 23:20:50,888.888 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T23:20:50.914 INFO:teuthology.kill:2022-10-17 23:20:50,913.913 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T23:20:50.975 INFO:teuthology.kill:2022-10-17 23:20:50,975.975 INFO:teuthology.orchestra.console:Power off smithi050 2022-10-17T23:20:51.013 INFO:teuthology.kill:2022-10-17 23:20:51,013.013 INFO:teuthology.orchestra.console:Power off smithi115 2022-10-17T23:20:59.374 INFO:teuthology.kill:2022-10-17 23:20:59,373.373 INFO:teuthology.orchestra.console:Power off for smithi115 completed 2022-10-17T23:20:59.532 INFO:teuthology.kill:2022-10-17 23:20:59,531.531 INFO:teuthology.lock.ops:unlocked: smithi115.front.sepia.ceph.com 2022-10-17T23:21:03.460 INFO:teuthology.kill:2022-10-17 23:21:03,460.460 INFO:teuthology.orchestra.console:Power off for smithi050 completed 2022-10-17T23:21:03.611 INFO:teuthology.kill:2022-10-17 23:21:03,611.611 INFO:teuthology.lock.ops:unlocked: smithi050.front.sepia.ceph.com 2022-10-17T23:23:03.969 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-17T23:23:04.089 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi050 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-10-17_17:32:58-rbd-wip-yuri-testing-2022-10-17-0746-quincy-distro-default-smithi/7070713 2022-10-17T23:23:04.089 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi115 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-10-17_17:32:58-rbd-wip-yuri-testing-2022-10-17-0746-quincy-distro-default-smithi/7070713