2022-10-16T17:42:27.569 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-16T17:42:27.704 INFO:teuthology.lock.ops:Start node 'smithi079.front.sepia.ceph.com' reimaging 2022-10-16T17:42:27.705 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: reset os type and version on server 2022-10-16T17:42:27.705 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-10-16T17:42:27.726 INFO:teuthology.lock.ops:Node 'smithi079.front.sepia.ceph.com' reimaging is complete 2022-10-16T17:42:27.727 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2022-10-16T17:42:27.727 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2022-10-16T17:42:27.727 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-10-16T17:42:27.747 INFO:teuthology.lock.ops:Node 'smithi170.front.sepia.ceph.com' reimaging is complete 2022-10-16T17:42:27.959 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of ubuntu 20.04 2022-10-16T17:42:27.968 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of ubuntu 20.04 2022-10-16T17:42:28.890 INFO:teuthology.orchestra.console:Power off smithi079 2022-10-16T17:42:29.002 INFO:teuthology.orchestra.console:Power off smithi170 2022-10-16T17:42:37.368 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-10-16T17:42:37.469 INFO:teuthology.orchestra.console:Power on smithi170 2022-10-16T17:42:41.380 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-10-16T17:42:41.481 INFO:teuthology.orchestra.console:Power on smithi079 2022-10-16T17:42:45.832 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2022-10-16T17:42:45.933 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2022-10-16T17:42:49.849 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2022-10-16T17:42:49.950 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2022-10-16T17:49:39.164 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-16T17:49:39.619 INFO:teuthology.provision.fog.smithi079:Node is ready 2022-10-16T17:49:39.626 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079.front.sepia.ceph.com 2022-10-16T17:49:39.677 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2022-10-16T17:49:39.913 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2022-10-16T17:51:11.632 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-16T17:51:12.188 INFO:teuthology.provision.fog.smithi170:Node is ready 2022-10-16T17:51:12.243 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2022-10-16T17:51:12.313 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2022-10-16T17:51:12.618 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2022-10-16T17:51:13.162 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2022-10-16T17:51:13.163 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-16T17:51:13.213 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2022-10-16T17:51:13.214 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-16T17:51:13.245 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2022-10-16T17:51:13.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-10-16T17:51:13.651 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2022-10-16T17:51:13.666 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2022-10-16T17:51:13.667 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-16T17:51:13.672 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2022-10-16T17:51:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2022-10-16T17:51:13.673 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-16T17:51:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="20.04" 2022-10-16T17:51:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-16T17:51:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-16T17:51:13.676 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-16T17:51:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-16T17:51:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=focal 2022-10-16T17:51:13.678 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=focal 2022-10-16T17:51:13.680 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2022-10-16T17:51:13.773 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2022-10-16T17:51:13.787 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-10-16T17:51:14.476 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2022-10-16T17:51:14.494 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Ubuntu" 2022-10-16T17:51:14.495 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-16T17:51:14.502 INFO:teuthology.orchestra.run.smithi170.stdout:ID=ubuntu 2022-10-16T17:51:14.503 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE=debian 2022-10-16T17:51:14.503 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-16T17:51:14.507 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="20.04" 2022-10-16T17:51:14.513 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-16T17:51:14.513 INFO:teuthology.orchestra.run.smithi170.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-16T17:51:14.514 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-16T17:51:14.514 INFO:teuthology.orchestra.run.smithi170.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-16T17:51:14.515 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_CODENAME=focal 2022-10-16T17:51:14.515 INFO:teuthology.orchestra.run.smithi170.stdout:UBUNTU_CODENAME=focal 2022-10-16T17:51:14.516 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-10-16T17:51:14.770 INFO:teuthology.dispatcher.supervisor:Running job 7069159 2022-10-16T17:51:14.771 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069159 --name amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069159/orig.config.yaml 2022-10-16T17:51:14.799 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069159 2022-10-16T17:51:14.812 INFO:teuthology.dispatcher.supervisor:Job PID: 11762 2022-10-16T17:51:14.812 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-17T05:52:08.972 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-17T05:52:09.116 INFO:teuthology.kill:Killing Pids: {11762} 2022-10-17T05:52:10.563 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-10-17T05:52:10.564 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-10-17T05:52:10.565 INFO:teuthology.misc:Compressing logs... 2022-10-17T05:52:10.565 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2022-10-17T05:52:10.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-10-17T05:52:11.079 INFO:teuthology.misc:Compressing logs... 2022-10-17T05:52:12.373 INFO:teuthology.misc:Compressing logs... 2022-10-17T05:55:27.365 INFO:teuthology.kill:No teuthology processes running 2022-10-17T05:55:28.824 INFO:teuthology.kill:Nuking machines: ['smithi079', 'smithi170'] 2022-10-17T05:55:30.180 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-17T05:55:30.181 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-17T05:55:30.181 INFO:teuthology.kill:2022-10-17 05:55:30,180.180 INFO:teuthology.nuke:targets: 2022-10-17T05:55:30.182 INFO:teuthology.kill: smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLAnn746p5FcDmWoFv9IZsU4PM1GroWsSp9rPQcmg66Hj33f5U9ikKhz3gFWI0HKfSWRn32gacpHcNzj6zMRzwLjWFyyXWXz4OYaumeUgjNa2HibXTdB7FlgLPbO43rDFGFI3s3Bg0QEWRv2f9aHGUtAQJWuHRhc2g3Av5OsGUbgFNTCOdeuAbC1IUnvuXAjtRw7niXX2kaT30Hwq8B+JJb4kRfGo5ZuKZ3/nhzy6oBPykVdWeJA5pl0nmxOiqyDzzd/g5BpmzNGLmHGECKPPTH9GD67YjtXxrKDmYuGJAcqRYpgBdCVzzRuIy4lBqpLbxh4vDXQSlL1lwqvRQMO5t5PxHAHIyBoUEbKH6rzesdN9PsTGg/PUKKlbYAGFmh0aGL8WCchYk3EpfEdLfiIBTFOcCB48t4oIf0Ygv8ySvN+C9Rd1hDs58p3oGpH5QgQJHlfJWPiHHNVGGs8uaK5hHUFR0i90MVulWncTgZNVpCEqol1SXsm+SP5yN/adieIs= 2022-10-17T05:55:30.182 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg3xgyqsbH6eKZCvbDgPh0ei++gOMkTITAzbE0h6QA/GPLFV6kUoVTsjCYN+g1rhd6QcB5Ga6MmVbZPW+bJ2pI+00//2de6dCUsUIO/v2OTv6ZSb/mDEziHpgKhTcHPTosh/ydanUsMyb8AMbIU6TUID9e4v5Q+cNzt5+gdi4k8Phmmkd954iMB8NUsMtfhyk6XnKfDOo1CTjjF6Br0oagsnQ3Oe7qOBHuI/14YvkBS2kGLNsji0jgpZZTMptGEPOrGUYkxtKKbmLH+sg3QIm+LMNEorGVIZCVIYM0AR8mk0s3HhrGbej6wnxYU5p9fCB7ftJ6SzomHf1iqRnjaMmwrNIlZUTimL21iUIxrxONlUwF6V+1rOFIiFe6PH5ex8dpsF6zcgr0XLaOATAxoEtnDdRY3tRE03iXr+jOtkjl7I0HAEd/f9yKXQYBd+2hRlNffgKT8CBynv2eJbRTcGb5j0q1r6taX5wRIp26jxPzzKLkqsARqZaU0o/1F3hH74U= 2022-10-17T05:55:30.183 INFO:teuthology.kill:2022-10-17 05:55:30,181.181 INFO:teuthology.nuke:Checking targets against current locks 2022-10-17T05:55:30.241 INFO:teuthology.kill:2022-10-17 05:55:30,240.240 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T05:55:30.268 INFO:teuthology.kill:2022-10-17 05:55:30,267.267 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T05:55:30.338 INFO:teuthology.kill:2022-10-17 05:55:30,337.337 INFO:teuthology.orchestra.console:Power off smithi079 2022-10-17T05:55:30.389 INFO:teuthology.kill:2022-10-17 05:55:30,388.388 INFO:teuthology.orchestra.console:Power off smithi170 2022-10-17T05:55:42.847 INFO:teuthology.kill:2022-10-17 05:55:42,846.846 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2022-10-17T05:55:42.887 INFO:teuthology.kill:2022-10-17 05:55:42,887.887 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-10-17T05:55:43.022 INFO:teuthology.kill:2022-10-17 05:55:43,020.020 INFO:teuthology.lock.ops:unlocked: smithi079.front.sepia.ceph.com 2022-10-17T05:55:43.042 INFO:teuthology.kill:2022-10-17 05:55:43,042.042 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2022-10-17T05:57:43.479 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-17T05:57:43.736 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi079 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069304 2022-10-17T05:57:43.737 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069304