2022-07-14T04:07:11.221 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-14T04:07:11.713 INFO:teuthology.lock.ops:Start node 'smithi134.front.sepia.ceph.com' reimaging 2022-07-14T04:07:11.744 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: reset os type and version on server 2022-07-14T04:07:11.745 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2022-07-14T04:07:11.819 INFO:teuthology.lock.ops:Node 'smithi134.front.sepia.ceph.com' reimaging is complete 2022-07-14T04:07:11.819 INFO:teuthology.lock.ops:Start node 'smithi201.front.sepia.ceph.com' reimaging 2022-07-14T04:07:11.820 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: reset os type and version on server 2022-07-14T04:07:11.820 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-07-14T04:07:11.867 INFO:teuthology.lock.ops:Node 'smithi201.front.sepia.ceph.com' reimaging is complete 2022-07-14T04:07:12.187 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of centos 8.stream 2022-07-14T04:07:12.225 INFO:teuthology.provision.fog.smithi201:Scheduling deploy of centos 8.stream 2022-07-14T04:07:12.897 INFO:teuthology.orchestra.console:Power off smithi134 2022-07-14T04:07:13.118 INFO:teuthology.orchestra.console:Power off smithi201 2022-07-14T04:07:21.777 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2022-07-14T04:07:21.807 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-07-14T04:07:21.879 INFO:teuthology.orchestra.console:Power on smithi134 2022-07-14T04:07:21.909 INFO:teuthology.orchestra.console:Power on smithi201 2022-07-14T04:07:26.312 INFO:teuthology.orchestra.console:Power on for smithi201 completed 2022-07-14T04:07:26.413 INFO:teuthology.provision.fog.smithi201:Waiting for deploy to finish 2022-07-14T04:07:30.497 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2022-07-14T04:07:30.610 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2022-07-14T04:12:03.259 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-14T04:12:03.482 INFO:teuthology.provision.fog.smithi134:Node is ready 2022-07-14T04:12:03.501 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2022-07-14T04:12:03.573 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2022-07-14T04:12:03.993 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2022-07-14T04:12:13.884 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-14T04:12:14.133 INFO:teuthology.provision.fog.smithi201:Node is ready 2022-07-14T04:12:14.193 INFO:teuthology.orchestra.run.smithi201.stdout:smithi201.front.sepia.ceph.com 2022-07-14T04:12:14.254 INFO:teuthology.orchestra.run.smithi201.stdout:172.21.15.201 smithi201.front.sepia.ceph.com smithi201 2022-07-14T04:12:14.672 INFO:teuthology.provision.fog.smithi201:Deploy complete! 2022-07-14T04:12:15.082 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2022-07-14T04:12:15.085 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-14T04:12:15.115 INFO:teuthology.lock.ops:Checking smithi201.front.sepia.ceph.com 2022-07-14T04:12:15.124 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-14T04:12:15.163 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2022-07-14T04:12:15.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2022-07-14T04:12:15.605 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2022-07-14T04:12:15.670 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2022-07-14T04:12:15.671 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2022-07-14T04:12:15.671 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2022-07-14T04:12:15.672 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2022-07-14T04:12:15.672 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2022-07-14T04:12:15.673 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2022-07-14T04:12:15.673 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-14T04:12:15.673 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2022-07-14T04:12:15.674 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-14T04:12:15.674 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2022-07-14T04:12:15.675 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-14T04:12:15.675 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-14T04:12:15.675 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-14T04:12:15.702 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2022-07-14T04:12:15.758 INFO:teuthology.lock.ops:Updating [smithi201.front.sepia.ceph.com]: set os type and version on server 2022-07-14T04:12:15.760 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-07-14T04:12:16.239 INFO:teuthology.orchestra.run.smithi201.stdout:x86_64 2022-07-14T04:12:16.323 INFO:teuthology.orchestra.run.smithi201.stdout:NAME="CentOS Stream" 2022-07-14T04:12:16.324 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION="8" 2022-07-14T04:12:16.325 INFO:teuthology.orchestra.run.smithi201.stdout:ID="centos" 2022-07-14T04:12:16.325 INFO:teuthology.orchestra.run.smithi201.stdout:ID_LIKE="rhel fedora" 2022-07-14T04:12:16.325 INFO:teuthology.orchestra.run.smithi201.stdout:VERSION_ID="8" 2022-07-14T04:12:16.326 INFO:teuthology.orchestra.run.smithi201.stdout:PLATFORM_ID="platform:el8" 2022-07-14T04:12:16.328 INFO:teuthology.orchestra.run.smithi201.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-14T04:12:16.328 INFO:teuthology.orchestra.run.smithi201.stdout:ANSI_COLOR="0;31" 2022-07-14T04:12:16.328 INFO:teuthology.orchestra.run.smithi201.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-14T04:12:16.329 INFO:teuthology.orchestra.run.smithi201.stdout:HOME_URL="https://centos.org/" 2022-07-14T04:12:16.329 INFO:teuthology.orchestra.run.smithi201.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-14T04:12:16.330 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-14T04:12:16.330 INFO:teuthology.orchestra.run.smithi201.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-14T04:12:16.332 INFO:teuthology.lock.ops:Updating smithi201.front.sepia.ceph.com on lock server 2022-07-14T04:12:16.572 INFO:teuthology.dispatcher.supervisor:Running job 6929819 2022-07-14T04:12:16.573 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_89d874d555f56b1c1f383df72487aecec0ee6cf9/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929819 --name ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929819/orig.config.yaml 2022-07-14T04:12:16.750 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-07-14_03:50:33-rados:thrash-erasure-code-main-distro-default-smithi/6929819 2022-07-14T04:12:16.752 INFO:teuthology.dispatcher.supervisor:Job PID: 28777 2022-07-14T04:12:16.755 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-14T16:13:20.095 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-14T16:13:20.259 INFO:teuthology.kill:Killing Pids: {28777} 2022-07-14T16:13:21.655 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-14T16:13:21.656 INFO:teuthology.task.internal:roles: ubuntu@smithi201.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-14T16:13:21.657 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:13:21.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2022-07-14T16:13:21.869 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi201.front.sepia.ceph.com' 2022-07-14T16:13:22.217 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:13:23.337 INFO:teuthology.orchestra.run.smithi201.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-14T16:13:23.353 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-14T16:13:24.011 INFO:teuthology.misc:Compressing logs... 2022-07-14T16:13:41.032 INFO:teuthology.kill:No teuthology processes running 2022-07-14T16:13:42.438 INFO:teuthology.kill:Nuking machines: ['smithi134', 'smithi201'] 2022-07-14T16:13:43.595 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_89d874d555f56b1c1f383df72487aecec0ee6cf9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-14T16:13:43.596 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-14T16:13:43.597 INFO:teuthology.kill:2022-07-14 16:13:43,595.595 INFO:teuthology.nuke:targets: 2022-07-14T16:13:43.597 INFO:teuthology.kill: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDN2DDCuCooWgTUnM/nD0pGCK9MzygxUvRE0yAM0fYK1T9slqLIcKaSDAzVGwkSJhCi1h8jsbD3B5XYCNfRATKtCaocwqB2ggHXaiPRUKL25Qf+yQXHnA/jyW0wxdAi0ZnXvpABUVSmele4d78IFG7tJbzT7CXTEsYT5nXKO41PASlhbfhXnquVOvOB7JgxaHKMgoOKLh8KQCpcEMJgGQsGoWwGalXu6qL58LjutyEL6aQ3ADSErDB2ZXk1OFWS2Q18sN0BHBrpHh6zluXycVPC/+p8f1KrbANBJ74CGvYm4s5JqSxdLuB+HVZXqKMz39+r1otXcRSV+7xj4xQoLPNTOEV7+iJgg16LQ5vDqoL71hrFtigEG8fcxsFsOP9uapgc5rwHzKuKBZYmftYy08FSSQLV+oYTZ5a5mJBnmKUbUQrAWnVSfRD+j9SBDqIhUGhqKX8OPpScXu4Y6nIxmeMw76NRg4fQcYqg+/CG3Vmirm59KtVvxjw715Dyhq5mbkE= 2022-07-14T16:13:43.597 INFO:teuthology.kill: smithi201.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9e0CPccMhZtwD7hVOzASTu/Pmayl24MsgMMOLfI4BQGtKTe6Q3BRMUL4YASC67DKSYKXrktcuWi5IZCCPp4pTerrTqsm1WCBwajoVQPsbvmPJGwj3T/SOOPG3uHip4vupgjkLmJDPXiTQn97YnwaU2V1qpHANHHjXMqulmGAR266GjCwe9b9hRKmE5P2nK4tlbiJKDtnOXYjXBA6skYvSukMtTu37qtZHn5vOjhL9D8WqrTMEgTsh3Y+ONjBTMI0za7RcmoeqJPN5qsmjPVmfrEtu/6g54SlnN9Z/K9qSYj5jkETTbV9FzwQxoyHk3E/1qtymGghqrLrrjLgz5tZ+JmKTuysCfH8WxDGl5U+IScydWQ31jDmlbYbf3cqnoi/o1OKVMpjPNQQGDw3gNhaYs1FJ9yahL6vxTculmvNMlkDWeE+UapqdXuZTEh5nt49QvIDxt2H3lwJAZiCXopYVS6UovGJCZr03kRY8M7MWTOPR74W8wPWvhzwDS1Q6aV0= 2022-07-14T16:13:43.597 INFO:teuthology.kill:2022-07-14 16:13:43,595.595 INFO:teuthology.nuke:Checking targets against current locks 2022-07-14T16:13:43.652 INFO:teuthology.kill:2022-07-14 16:13:43,651.651 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-14T16:13:43.676 INFO:teuthology.kill:2022-07-14 16:13:43,676.676 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-14T16:13:43.738 INFO:teuthology.kill:2022-07-14 16:13:43,737.737 INFO:teuthology.orchestra.console:Power off smithi134 2022-07-14T16:13:43.774 INFO:teuthology.kill:2022-07-14 16:13:43,774.774 INFO:teuthology.orchestra.console:Power off smithi201 2022-07-14T16:13:52.112 INFO:teuthology.kill:2022-07-14 16:13:52,112.112 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2022-07-14T16:13:52.136 INFO:teuthology.kill:2022-07-14 16:13:52,135.135 INFO:teuthology.orchestra.console:Power off for smithi201 completed 2022-07-14T16:13:52.267 INFO:teuthology.kill:2022-07-14 16:13:52,266.266 INFO:teuthology.lock.ops:unlocked: smithi134.front.sepia.ceph.com 2022-07-14T16:13:52.285 INFO:teuthology.kill:2022-07-14 16:13:52,284.284 INFO:teuthology.lock.ops:unlocked: smithi201.front.sepia.ceph.com 2022-07-14T16:15:52.622 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-14T16:15:52.732 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi134 but it was locked by another job: /home/teuthworker/archive/dis-2022-07-14_12:28:20-rbd-wip-dis-testing-distro-default-smithi/6930474 2022-07-14T16:15:52.733 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi201 but it was locked by another job: /home/teuthworker/archive/dis-2022-07-14_12:28:20-rbd-wip-dis-testing-distro-default-smithi/6930474