2022-07-14T04:06:25.501 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-14T04:06:25.847 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2022-07-14T04:06:25.848 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2022-07-14T04:06:25.849 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-07-14T04:06:25.884 INFO:teuthology.lock.ops:Node 'smithi124.front.sepia.ceph.com' reimaging is complete 2022-07-14T04:06:25.885 INFO:teuthology.lock.ops:Start node 'smithi138.front.sepia.ceph.com' reimaging 2022-07-14T04:06:25.891 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: reset os type and version on server 2022-07-14T04:06:25.892 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-07-14T04:06:25.922 INFO:teuthology.lock.ops:Node 'smithi138.front.sepia.ceph.com' reimaging is complete 2022-07-14T04:06:26.117 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of centos 8.stream 2022-07-14T04:06:26.170 INFO:teuthology.provision.fog.smithi138:Scheduling deploy of centos 8.stream 2022-07-14T04:06:26.696 INFO:teuthology.orchestra.console:Power off smithi138 2022-07-14T04:06:26.775 INFO:teuthology.orchestra.console:Power off smithi124 2022-07-14T04:06:35.369 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-07-14T04:06:35.489 INFO:teuthology.orchestra.console:Power on smithi124 2022-07-14T04:06:39.454 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-07-14T04:06:39.565 INFO:teuthology.orchestra.console:Power on smithi138 2022-07-14T04:06:39.949 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2022-07-14T04:06:40.053 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2022-07-14T04:06:48.098 INFO:teuthology.orchestra.console:Power on for smithi138 completed 2022-07-14T04:06:48.200 INFO:teuthology.provision.fog.smithi138:Waiting for deploy to finish 2022-07-14T04:10:47.014 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-14T04:10:55.322 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-14T04:11:12.140 INFO:teuthology.provision.fog.smithi124:Node is ready 2022-07-14T04:11:12.197 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2022-07-14T04:11:12.268 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2022-07-14T04:11:12.779 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2022-07-14T04:11:20.762 INFO:teuthology.provision.fog.smithi138:Node is ready 2022-07-14T04:11:20.788 INFO:teuthology.orchestra.run.smithi138.stdout:smithi138.front.sepia.ceph.com 2022-07-14T04:11:20.868 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.15.138 smithi138.front.sepia.ceph.com smithi138 2022-07-14T04:11:21.269 INFO:teuthology.provision.fog.smithi138:Deploy complete! 2022-07-14T04:11:21.591 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2022-07-14T04:11:21.592 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-14T04:11:21.660 INFO:teuthology.lock.ops:Checking smithi138.front.sepia.ceph.com 2022-07-14T04:11:21.660 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-14T04:11:21.755 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2022-07-14T04:11:21.756 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-07-14T04:11:22.167 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2022-07-14T04:11:22.232 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="CentOS Stream" 2022-07-14T04:11:22.232 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8" 2022-07-14T04:11:22.233 INFO:teuthology.orchestra.run.smithi124.stdout:ID="centos" 2022-07-14T04:11:22.233 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="rhel fedora" 2022-07-14T04:11:22.233 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8" 2022-07-14T04:11:22.244 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2022-07-14T04:11:22.245 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-14T04:11:22.245 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2022-07-14T04:11:22.246 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-14T04:11:22.246 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://centos.org/" 2022-07-14T04:11:22.247 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-14T04:11:22.247 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-14T04:11:22.248 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-14T04:11:22.266 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-07-14T04:11:22.337 INFO:teuthology.lock.ops:Updating [smithi138.front.sepia.ceph.com]: set os type and version on server 2022-07-14T04:11:22.339 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-07-14T04:11:22.854 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2022-07-14T04:11:22.917 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="CentOS Stream" 2022-07-14T04:11:22.917 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="8" 2022-07-14T04:11:22.918 INFO:teuthology.orchestra.run.smithi138.stdout:ID="centos" 2022-07-14T04:11:22.918 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE="rhel fedora" 2022-07-14T04:11:22.918 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="8" 2022-07-14T04:11:22.918 INFO:teuthology.orchestra.run.smithi138.stdout:PLATFORM_ID="platform:el8" 2022-07-14T04:11:22.919 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-14T04:11:22.919 INFO:teuthology.orchestra.run.smithi138.stdout:ANSI_COLOR="0;31" 2022-07-14T04:11:22.919 INFO:teuthology.orchestra.run.smithi138.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-14T04:11:22.921 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://centos.org/" 2022-07-14T04:11:22.958 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-14T04:11:22.958 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-14T04:11:22.959 INFO:teuthology.orchestra.run.smithi138.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-14T04:11:22.960 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2022-07-14T04:11:23.250 INFO:teuthology.dispatcher.supervisor:Running job 6929818 2022-07-14T04:11:23.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_89d874d555f56b1c1f383df72487aecec0ee6cf9/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929818 --name ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929818/orig.config.yaml 2022-07-14T04:11:23.306 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929818 2022-07-14T04:11:23.307 INFO:teuthology.dispatcher.supervisor:Job PID: 9083 2022-07-14T04:11:23.308 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-14T16:12:26.508 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-14T16:12:26.684 INFO:teuthology.kill:Killing Pids: {9083} 2022-07-14T16:12:28.180 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-14T16:12:28.181 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-14T16:12:28.182 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:12:28.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-07-14T16:12:28.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2022-07-14T16:12:28.774 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:12:29.886 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-14T16:12:29.919 INFO:teuthology.orchestra.run.smithi138.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-14T16:12:30.586 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:13:00.667 INFO:teuthology.kill:No teuthology processes running 2022-07-14T16:13:02.097 INFO:teuthology.kill:Nuking machines: ['smithi124', 'smithi138'] 2022-07-14T16:13:03.293 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_89d874d555f56b1c1f383df72487aecec0ee6cf9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-14T16:13:03.294 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-14T16:13:03.295 INFO:teuthology.kill:2022-07-14 16:13:03,293.293 INFO:teuthology.nuke:targets: 2022-07-14T16:13:03.295 INFO:teuthology.kill: smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaZIHD9ujmkl070WORQ4lhQOdXJ6r9xfm0RWRGEzS1Waxh4c9gfgntzn5mEBLGHzsbUvKlW4q1tIXDBfE7A4kAEC1foGkk+oUDOtOWXbJnFs+2SgfYt0buuBghmr+cmjZXZO9ABHwHIjSJE269/XUSoeuCVd4W+pn8wCuFhags4II5JTiaMOQIVye2InzYPoRvpm08yr4U4/TPBRXjdZB6RAAl90XSQv85zL4+mzlg/W9LDIsyb0fb7ZRqeIhflDL3vR+bkSOPXh5jrJCLKGmT1a98cpAA2kgtrZecJ/AVhZCCIJ4jET2QFI5qD3JJ+G2CRWyKcexpwr8orsiFeH+SUQUt6WEzOYzkYpqhEE+pZAIzxNuxO8JQmL/FlbMoC5NjqoWFC71KXHCTc7Gl34bFyjw01XzOnBejhJyFFAG06ojrNaHBaDJLIUcP7ncqMtEHSY5hfcZqh4NeuZN6YH44ZL7s9omyLzjW0wW5xW2RENokjEP4PvxLgP7GJUShmJM= 2022-07-14T16:13:03.295 INFO:teuthology.kill: smithi138.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZXlM3fGTWc6m0O5mTBpQTPPHwCM2jbJ98R1iOG5DFr6R2M7dIxIXMltYGM+D+EKY+WJRIUnmGVOXwAdObDubX3mG0oJez180xpF/HtrJv5F0T7LpTHfTK4cZL8KD7x7sjCh+AW71Jypw0KYWdKLKiu1hr2Ps9en/tsNWB6MSkBYOHvZtFfRNtSw7LhqflhVnzO55kFljKNyB4HTu2fnuVClRuvhnKDH+TPtKUUb+8K26Q2Q0Qoq16rmiZpv/FzbK0ax5pBtgR8y9oHaJo2U1A28QQHs4undqesctMqXHwgICspfcg2/LWmjlD25v6mnaO1/C7FRIKS6dNX2o1VIocXhf0v4H0mSINk33bvaciigzR7eYJCIGrGDLJ3AnLAQCgKyGb/moim1CqrwMPbXagQYyKJZVz6aYjDj5J+c7Z3XmLEq7nOY9eNhtfiifo7pxNHgHVNt/UntdDkwP+XZFBtPwZ4fgssx0gCN6IYNmC4WFrHMohL5jFtwiv0F6mD+8= 2022-07-14T16:13:03.296 INFO:teuthology.kill:2022-07-14 16:13:03,293.293 INFO:teuthology.nuke:Checking targets against current locks 2022-07-14T16:13:03.351 INFO:teuthology.kill:2022-07-14 16:13:03,351.351 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-14T16:13:03.384 INFO:teuthology.kill:2022-07-14 16:13:03,384.384 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-14T16:13:03.444 INFO:teuthology.kill:2022-07-14 16:13:03,444.444 INFO:teuthology.orchestra.console:Power off smithi124 2022-07-14T16:13:03.495 INFO:teuthology.kill:2022-07-14 16:13:03,494.494 INFO:teuthology.orchestra.console:Power off smithi138 2022-07-14T16:13:15.923 INFO:teuthology.kill:2022-07-14 16:13:15,922.922 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-07-14T16:13:15.969 INFO:teuthology.kill:2022-07-14 16:13:15,969.969 INFO:teuthology.orchestra.console:Power off for smithi138 completed 2022-07-14T16:13:16.075 INFO:teuthology.kill:2022-07-14 16:13:16,074.074 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2022-07-14T16:13:16.120 INFO:teuthology.kill:2022-07-14 16:13:16,120.120 INFO:teuthology.lock.ops:unlocked: smithi138.front.sepia.ceph.com 2022-07-14T16:15:16.468 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-14T16:15:16.593 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/dis-2022-07-14_12:28:20-rbd-wip-dis-testing-distro-default-smithi/6930473 2022-07-14T16:15:16.594 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi138 but it was locked by another job: /home/teuthworker/archive/dis-2022-07-14_12:28:20-rbd-wip-dis-testing-distro-default-smithi/6930472