2022-10-16T17:42:20.368 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-16T17:42:20.502 INFO:teuthology.lock.ops:Start node 'smithi083.front.sepia.ceph.com' reimaging 2022-10-16T17:42:20.503 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: reset os type and version on server 2022-10-16T17:42:20.503 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-10-16T17:42:20.524 INFO:teuthology.lock.ops:Node 'smithi083.front.sepia.ceph.com' reimaging is complete 2022-10-16T17:42:20.524 INFO:teuthology.lock.ops:Start node 'smithi190.front.sepia.ceph.com' reimaging 2022-10-16T17:42:20.524 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: reset os type and version on server 2022-10-16T17:42:20.525 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2022-10-16T17:42:20.545 INFO:teuthology.lock.ops:Node 'smithi190.front.sepia.ceph.com' reimaging is complete 2022-10-16T17:42:20.776 INFO:teuthology.provision.fog.smithi190:Scheduling deploy of ubuntu 20.04 2022-10-16T17:42:20.816 INFO:teuthology.provision.fog.smithi083:Scheduling deploy of ubuntu 20.04 2022-10-16T17:42:21.418 INFO:teuthology.orchestra.console:Power off smithi190 2022-10-16T17:42:21.465 INFO:teuthology.orchestra.console:Power off smithi083 2022-10-16T17:42:29.801 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-10-16T17:42:29.830 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-10-16T17:42:29.903 INFO:teuthology.orchestra.console:Power on smithi190 2022-10-16T17:42:29.931 INFO:teuthology.orchestra.console:Power on smithi083 2022-10-16T17:42:38.268 INFO:teuthology.orchestra.console:Power on for smithi190 completed 2022-10-16T17:42:38.284 INFO:teuthology.orchestra.console:Power on for smithi083 completed 2022-10-16T17:42:38.370 INFO:teuthology.provision.fog.smithi190:Waiting for deploy to finish 2022-10-16T17:42:38.385 INFO:teuthology.provision.fog.smithi083:Waiting for deploy to finish 2022-10-16T17:49:15.886 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-16T17:49:16.342 INFO:teuthology.provision.fog.smithi190:Node is ready 2022-10-16T17:49:16.391 INFO:teuthology.orchestra.run.smithi190.stdout:smithi190.front.sepia.ceph.com 2022-10-16T17:49:16.398 INFO:teuthology.orchestra.run.smithi190.stdout:172.21.15.190 smithi190.front.sepia.ceph.com smithi190 2022-10-16T17:49:16.559 INFO:teuthology.provision.fog.smithi190:Deploy complete! 2022-10-16T17:49:59.058 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-10-16T17:49:59.532 INFO:teuthology.provision.fog.smithi083:Node is ready 2022-10-16T17:49:59.540 INFO:teuthology.orchestra.run.smithi083.stdout:smithi083.front.sepia.ceph.com 2022-10-16T17:49:59.598 INFO:teuthology.orchestra.run.smithi083.stdout:172.21.15.83 smithi083.front.sepia.ceph.com smithi083 2022-10-16T17:49:59.762 INFO:teuthology.provision.fog.smithi083:Deploy complete! 2022-10-16T17:50:00.112 INFO:teuthology.lock.ops:Checking smithi083.front.sepia.ceph.com 2022-10-16T17:50:00.114 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-16T17:50:00.148 INFO:teuthology.lock.ops:Checking smithi190.front.sepia.ceph.com 2022-10-16T17:50:00.148 INFO:teuthology.lock.ops:New key found. Updating... 2022-10-16T17:50:00.171 INFO:teuthology.lock.ops:Updating [smithi083.front.sepia.ceph.com]: set os type and version on server 2022-10-16T17:50:00.172 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-10-16T17:50:00.434 INFO:teuthology.orchestra.run.smithi083.stdout:x86_64 2022-10-16T17:50:00.441 INFO:teuthology.orchestra.run.smithi083.stdout:NAME="Ubuntu" 2022-10-16T17:50:00.442 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-16T17:50:00.442 INFO:teuthology.orchestra.run.smithi083.stdout:ID=ubuntu 2022-10-16T17:50:00.442 INFO:teuthology.orchestra.run.smithi083.stdout:ID_LIKE=debian 2022-10-16T17:50:00.443 INFO:teuthology.orchestra.run.smithi083.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-16T17:50:00.443 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_ID="20.04" 2022-10-16T17:50:00.443 INFO:teuthology.orchestra.run.smithi083.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-16T17:50:00.443 INFO:teuthology.orchestra.run.smithi083.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-16T17:50:00.444 INFO:teuthology.orchestra.run.smithi083.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-16T17:50:00.445 INFO:teuthology.orchestra.run.smithi083.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-16T17:50:00.445 INFO:teuthology.orchestra.run.smithi083.stdout:VERSION_CODENAME=focal 2022-10-16T17:50:00.445 INFO:teuthology.orchestra.run.smithi083.stdout:UBUNTU_CODENAME=focal 2022-10-16T17:50:00.446 INFO:teuthology.lock.ops:Updating smithi083.front.sepia.ceph.com on lock server 2022-10-16T17:50:00.467 INFO:teuthology.lock.ops:Updating [smithi190.front.sepia.ceph.com]: set os type and version on server 2022-10-16T17:50:00.468 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2022-10-16T17:50:00.754 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2022-10-16T17:50:00.806 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2022-10-16T17:50:00.806 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="20.04.5 LTS (Focal Fossa)" 2022-10-16T17:50:00.806 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2022-10-16T17:50:00.807 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2022-10-16T17:50:00.807 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 20.04.5 LTS" 2022-10-16T17:50:00.807 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="20.04" 2022-10-16T17:50:00.808 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2022-10-16T17:50:00.808 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-10-16T17:50:00.808 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-10-16T17:50:00.808 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-10-16T17:50:00.809 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=focal 2022-10-16T17:50:00.809 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=focal 2022-10-16T17:50:00.809 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2022-10-16T17:50:00.919 INFO:teuthology.dispatcher.supervisor:Running job 7069138 2022-10-16T17:50:00.920 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069138 --name amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069138/orig.config.yaml 2022-10-16T17:50:00.925 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-10-16_17:40:13-rados-testing-laggy-distro-default-smithi/7069138 2022-10-16T17:50:00.926 INFO:teuthology.dispatcher.supervisor:Job PID: 18765 2022-10-16T17:50:00.927 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-10-17T05:50:23.445 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-10-17T05:50:23.622 INFO:teuthology.kill:Killing Pids: {18765} 2022-10-17T05:50:24.977 INFO:teuthology.task.internal:roles: ubuntu@smithi083.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-10-17T05:50:24.978 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-10-17T05:50:24.978 INFO:teuthology.misc:Compressing logs... 2022-10-17T05:50:24.979 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi083.front.sepia.ceph.com' 2022-10-17T05:50:25.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2022-10-17T05:50:25.558 INFO:teuthology.misc:Compressing logs... 2022-10-17T05:50:26.915 INFO:teuthology.misc:Compressing logs... 2022-10-17T06:07:25.892 INFO:teuthology.kill:No teuthology processes running 2022-10-17T06:07:27.389 INFO:teuthology.kill:Nuking machines: ['smithi083', 'smithi190'] 2022-10-17T06:07:28.567 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_35ea38a9840006713a3d42472a2c536a25e88c15/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-10-17T06:07:28.568 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-10-17T06:07:28.569 INFO:teuthology.kill:2022-10-17 06:07:28,567.567 INFO:teuthology.nuke:targets: 2022-10-17T06:07:28.569 INFO:teuthology.kill: smithi083.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6DMwVhsrKcd00SzBK+srjmyksyxxzQgRJeDt4XV9yQESFlAUBBAalHWQGPtCYnzS/4cJjXNcUzRrvTUKx0xVh5aOnKs4BF7xikRA4DY/rsa7E+pWXv0xJ8ipe3Psy3pw2r/w011tPkI1WG/BKuPNFRFz98PHsVZ9UrSiggXsOLbfMLAsjiSo4277Zb2XxFhRrEbnQDTA0JInCyrINfCT9xqbF6UfavtlHZwfh3XxU6WdnoixNZ9CdoQVradwEjXBLhjXKQspFSzkm/M2zPZ0mVthyaB6St2tQwVoiGQyY6rjxI5wCsRfPajx6wQy4RXGdyk9MR50GgEmVrOJP5KRuCAJ3JspQVUNEk8qwmfTcGNIvJcJee1t6ynuXxebO29TEiXDCxD7FDyiYpZZxSeYt6gH50PjzxEe4kVVd00WffWcZSSbNisceZ52pDHKj54oEdWsG34RCBmqn06D2pt87tsaTZtSTY3Gvwi8AkCBEdZXUAN0byduOLeXUWF/gvXs= 2022-10-17T06:07:28.569 INFO:teuthology.kill: smithi190.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDdoDrZHQH1waCNYg/denOMUiJnk1bZ36sBV3hJOQMR8Dl1DfZRjBQGFzajJFrPpLdBl9pn4mngpBJ/b6jAsezBtwk2CwHbpmIGvgTpmxz7xnJx6bF0ZNQir/cHAFo3ee6Xu7gpRFvjDf3+ZkbACQF3Q9P2dslITFUiLe05Gq54ivL1iaXvObA+96hdvkukz7uKQGggC8duK69e6MHTuFv+Aio5Q8IRlgCRNernta4nVDtT28hCEoKaA1Ew6Se0HIWXhhu5/ViDijUgCUybs2WOtoCMo2J0EhCHRIqlpKJg1BMefZpgnbvKGms1yfn9fIvj4g2ULhZAolZCgPEVxS1ENOzHNvJd4fULPsQeWjvgGpyCE2iuo6pC0y0fYlBm8SmqRgx2scMvWmxm+FLneGGVcz7TzYUMj0gYBIL2EpVahR1XevuX8I1HIHjz/nBa8ndjJ0EUiR5TiA9W2JIa10K9cfoSbOQqBC7By0eIBz3uqhejUa715JJvtD+5bmwAKFs= 2022-10-17T06:07:28.569 INFO:teuthology.kill:2022-10-17 06:07:28,567.567 INFO:teuthology.nuke:Checking targets against current locks 2022-10-17T06:07:28.621 INFO:teuthology.kill:2022-10-17 06:07:28,621.621 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T06:07:28.645 INFO:teuthology.kill:2022-10-17 06:07:28,644.644 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-10-17T06:07:28.701 INFO:teuthology.kill:2022-10-17 06:07:28,700.700 INFO:teuthology.orchestra.console:Power off smithi083 2022-10-17T06:07:28.738 INFO:teuthology.kill:2022-10-17 06:07:28,738.738 INFO:teuthology.orchestra.console:Power off smithi190 2022-10-17T06:07:37.076 INFO:teuthology.kill:2022-10-17 06:07:37,076.076 INFO:teuthology.orchestra.console:Power off for smithi083 completed 2022-10-17T06:07:37.098 INFO:teuthology.kill:2022-10-17 06:07:37,098.098 INFO:teuthology.orchestra.console:Power off for smithi190 completed 2022-10-17T06:07:37.233 INFO:teuthology.kill:2022-10-17 06:07:37,232.232 INFO:teuthology.lock.ops:unlocked: smithi083.front.sepia.ceph.com 2022-10-17T06:07:37.252 INFO:teuthology.kill:2022-10-17 06:07:37,252.252 INFO:teuthology.lock.ops:unlocked: smithi190.front.sepia.ceph.com 2022-10-17T06:09:37.577 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-10-17T06:09:37.685 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi083 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069319 2022-10-17T06:09:37.685 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi190 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-10-17_02:01:03-rbd-quincy-distro-default-smithi/7069319