2022-08-03T01:09:51.187 INFO:root:teuthology version: 1.1.1.dev401+gdd7eb9d9 2022-08-03T01:09:51.324 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-08-03T01:09:51.325 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-08-03T01:09:51.325 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-08-03T01:09:51.346 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-08-03T01:09:51.347 INFO:teuthology.lock.ops:Start node 'smithi133.front.sepia.ceph.com' reimaging 2022-08-03T01:09:51.347 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: reset os type and version on server 2022-08-03T01:09:51.348 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-08-03T01:09:51.368 INFO:teuthology.lock.ops:Node 'smithi133.front.sepia.ceph.com' reimaging is complete 2022-08-03T01:09:51.562 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2022-08-03T01:09:51.585 INFO:teuthology.provision.fog.smithi133:Scheduling deploy of centos 8.stream 2022-08-03T01:09:51.885 INFO:teuthology.orchestra.console:Power off smithi055 2022-08-03T01:09:51.902 INFO:teuthology.orchestra.console:Power off smithi133 2022-08-03T01:10:04.371 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-08-03T01:10:04.376 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-08-03T01:10:04.473 INFO:teuthology.orchestra.console:Power on smithi055 2022-08-03T01:10:04.481 INFO:teuthology.orchestra.console:Power on smithi133 2022-08-03T01:10:08.729 INFO:teuthology.orchestra.console:Power on for smithi133 completed 2022-08-03T01:10:08.837 INFO:teuthology.provision.fog.smithi133:Waiting for deploy to finish 2022-08-03T01:10:12.837 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-08-03T01:10:12.938 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-08-03T01:12:39.941 ERROR:teuthology.orchestra.connection:Error authenticating with smithi133.front.sepia.ceph.com: Authentication failed. 2022-08-03T01:14:26.947 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-03T01:14:27.236 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-08-03T01:14:27.255 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-08-03T01:14:27.315 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-08-03T01:14:27.657 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-08-03T01:14:48.794 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-08-03T01:14:49.031 INFO:teuthology.provision.fog.smithi133:Node is ready 2022-08-03T01:14:49.048 INFO:teuthology.orchestra.run.smithi133.stdout:smithi133.front.sepia.ceph.com 2022-08-03T01:14:49.107 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.15.133 smithi133.front.sepia.ceph.com smithi133 2022-08-03T01:14:49.447 INFO:teuthology.provision.fog.smithi133:Deploy complete! 2022-08-03T01:14:49.630 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-08-03T01:14:49.631 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-03T01:14:49.655 INFO:teuthology.lock.ops:Checking smithi133.front.sepia.ceph.com 2022-08-03T01:14:49.655 INFO:teuthology.lock.ops:New key found. Updating... 2022-08-03T01:14:49.677 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-08-03T01:14:49.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-08-03T01:14:49.890 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-08-03T01:14:49.953 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2022-08-03T01:14:49.954 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2022-08-03T01:14:49.954 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2022-08-03T01:14:49.954 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2022-08-03T01:14:49.954 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2022-08-03T01:14:49.955 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-08-03T01:14:49.955 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-03T01:14:49.955 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-08-03T01:14:49.955 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-03T01:14:49.956 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2022-08-03T01:14:49.956 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-03T01:14:49.956 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-03T01:14:49.956 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-03T01:14:49.958 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-08-03T01:14:49.978 INFO:teuthology.lock.ops:Updating [smithi133.front.sepia.ceph.com]: set os type and version on server 2022-08-03T01:14:49.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-08-03T01:14:50.182 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2022-08-03T01:14:50.240 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="CentOS Stream" 2022-08-03T01:14:50.240 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="8" 2022-08-03T01:14:50.240 INFO:teuthology.orchestra.run.smithi133.stdout:ID="centos" 2022-08-03T01:14:50.240 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE="rhel fedora" 2022-08-03T01:14:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="8" 2022-08-03T01:14:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:PLATFORM_ID="platform:el8" 2022-08-03T01:14:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="CentOS Stream 8" 2022-08-03T01:14:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:ANSI_COLOR="0;31" 2022-08-03T01:14:50.242 INFO:teuthology.orchestra.run.smithi133.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-08-03T01:14:50.242 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://centos.org/" 2022-08-03T01:14:50.242 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-08-03T01:14:50.242 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-08-03T01:14:50.243 INFO:teuthology.orchestra.run.smithi133.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-08-03T01:14:50.243 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2022-08-03T01:14:50.374 INFO:teuthology.dispatcher.supervisor:Running job 6955953 2022-08-03T01:14:50.374 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_dd7eb9d989259767783fb5ee9a761cd0732b84e6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-08-02_21:20:37-fs-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6955953 --name yuriw-2022-08-02_21:20:37-fs-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{frag multifs session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_snaptests}} -- /home/teuthworker/archive/yuriw-2022-08-02_21:20:37-fs-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6955953/orig.config.yaml 2022-08-03T01:14:50.380 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-08-02_21:20:37-fs-wip-yuri7-testing-2022-07-27-0808-quincy-distro-default-smithi/6955953 2022-08-03T01:14:50.382 INFO:teuthology.dispatcher.supervisor:Job PID: 24969 2022-08-03T01:14:50.382 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-08-03T13:15:13.909 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-08-03T13:15:14.100 INFO:teuthology.kill:Killing Pids: {24969} 2022-08-03T13:15:15.596 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-08-03T13:15:15.597 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2022-08-03T13:15:15.597 INFO:teuthology.misc:Compressing logs... 2022-08-03T13:15:15.598 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-08-03T13:15:15.836 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2022-08-03T13:15:16.467 INFO:teuthology.misc:Compressing logs... 2022-08-03T13:18:07.392 INFO:teuthology.misc:Compressing logs... 2022-08-03T13:20:53.145 INFO:teuthology.orchestra.run.smithi055.stderr:tar: .: file changed as we read it 2022-08-03T13:21:14.955 INFO:teuthology.kill:No teuthology processes running 2022-08-03T13:21:16.531 INFO:teuthology.kill:Nuking machines: ['smithi055', 'smithi133'] 2022-08-03T13:21:17.681 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_dd7eb9d989259767783fb5ee9a761cd0732b84e6/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-08-03T13:21:17.682 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-08-03T13:21:17.682 INFO:teuthology.kill:2022-08-03 13:21:17,680.680 INFO:teuthology.nuke:targets: 2022-08-03T13:21:17.682 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCfE3ofoBThsQ32lRG99Bnsv12n8NWItTwJUSXgIx0JxLM3BzJ2IaVr6TqSIh4TMVEbNRa89VPiUHtWIvvIp0HJioARh2QDb3vkATEy4P78D8J3Z1tXH9eBw5KdupVSULOXcojPfRkfcgrRdw7qpLhTAQXYQbsSeZJiqFKY46tMUHg+gntHRVtOA5O+qiyO6qGZLajaoOLh68LwW/D6jjBZW8pFtTVxwVpVr2MFNsLg7RZPLFxKvzy2mEwJ3jkt+vLjHvCtXvVlJs2eBxyDsABcNzCYJSI+PHXTjnMUu7pYSmThw95t7QlPlBHDGQpVEA9WAmx5RQA2L6B+Snam5iR/qdAF0pC3Yjqau4BaM4FR/WaU0Kov+NLEox43SzMjmo8PcjV3AHKjOJuAQ6rrC8II1UVj1IqeOKDwUer7GWR8BgxX3eEJgl0r1/WCrwiSsU9XMvOBKxQiMOVrAiq2RQ9Vp46nc2YPK1YPRWZYeKOW1KGuYGa/knkWom7dkdAoSks= 2022-08-03T13:21:17.683 INFO:teuthology.kill: smithi133.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM+t3EF7/DdEnLyOnxkxFI9FXsmTKau/AZjHsnL0iiutelXktewf2bgwb54l6WqJP9G4FWMEvJLRU64QSUNmFFIP4cwuHXcoAgSTzvq9l2Trg3twY4n4iB3hIJKIMSojm5sCU3iHCzPk6BGcVWlsHukL8q1eIUIOnqXj1BVbyoAMUQveCa5EDC+7FUez6jQbqpmUdYciK7vZHluuEilWloaJZC1WdQ6igZiyHF5uoEls51tgahKaQM0mEBDGj7ELSYZVBdtU9L4uzSMQrOxF8k3eH1FUKFBbSJ6hiQmJrjW4E9+bbKKhaOhE8KpoajMXeydQhy+dH9uAU02FYEZRivKpNnPg1jR2nctKaES8PBaBSgOE1/YDzotDmH1PHZl/DpIanJr+NQ5fCu8PEZB6jKovsIEbtZ0rwjFN5nsgAToPOYmJy3AQ6+gzN+hZgM/GHI3EwgIkLgYr8xQWjg7dd+vb6rRixnkl+vZkcbL3c5miqMCGu71cb7M/pfyZK6B4E= 2022-08-03T13:21:17.683 INFO:teuthology.kill:2022-08-03 13:21:17,681.681 INFO:teuthology.nuke:Checking targets against current locks 2022-08-03T13:21:17.747 INFO:teuthology.kill:2022-08-03 13:21:17,747.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-03T13:21:17.775 INFO:teuthology.kill:2022-08-03 13:21:17,774.774 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-03T13:21:17.840 INFO:teuthology.kill:2022-08-03 13:21:17,840.840 INFO:teuthology.orchestra.console:Power off smithi055 2022-08-03T13:21:17.862 INFO:teuthology.kill:2022-08-03 13:21:17,861.861 INFO:teuthology.orchestra.console:Power off smithi133 2022-08-03T13:21:26.239 INFO:teuthology.kill:2022-08-03 13:21:26,239.239 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-08-03T13:21:26.396 INFO:teuthology.kill:2022-08-03 13:21:26,395.395 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-08-03T13:21:30.372 INFO:teuthology.kill:2022-08-03 13:21:30,371.371 INFO:teuthology.orchestra.console:Power off for smithi133 completed 2022-08-03T13:21:30.525 INFO:teuthology.kill:2022-08-03 13:21:30,525.525 INFO:teuthology.lock.ops:unlocked: smithi133.front.sepia.ceph.com 2022-08-03T13:23:30.835 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-08-03T13:23:30.984 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-08-03_12:58:49-upgrade:octopus-x:parallel-quincy-distro-default-smithi/6956390 2022-08-03T13:23:30.985 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi133 but it was locked by another job: /home/teuthworker/archive/pdonnell-2022-08-03_12:58:49-upgrade:octopus-x:parallel-quincy-distro-default-smithi/6956390