2022-07-09T05:49:12.275 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-09T05:49:12.516 INFO:teuthology.lock.ops:Start node 'smithi124.front.sepia.ceph.com' reimaging 2022-07-09T05:49:12.517 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: reset os type and version on server 2022-07-09T05:49:12.518 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-07-09T05:49:12.554 INFO:teuthology.lock.ops:Node 'smithi124.front.sepia.ceph.com' reimaging is complete 2022-07-09T05:49:12.554 INFO:teuthology.lock.ops:Start node 'smithi170.front.sepia.ceph.com' reimaging 2022-07-09T05:49:12.555 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: reset os type and version on server 2022-07-09T05:49:12.555 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-07-09T05:49:12.588 INFO:teuthology.lock.ops:Node 'smithi170.front.sepia.ceph.com' reimaging is complete 2022-07-09T05:49:12.824 INFO:teuthology.provision.fog.smithi124:Scheduling deploy of rhel 8.6 2022-07-09T05:49:12.848 INFO:teuthology.provision.fog.smithi170:Scheduling deploy of rhel 8.6 2022-07-09T05:49:13.282 INFO:teuthology.orchestra.console:Power off smithi124 2022-07-09T05:49:13.346 INFO:teuthology.orchestra.console:Power off smithi170 2022-07-09T05:49:13.464 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-07-09T05:49:13.526 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-07-09T05:49:13.575 INFO:teuthology.orchestra.console:Power on smithi124 2022-07-09T05:49:13.628 INFO:teuthology.orchestra.console:Power on smithi170 2022-07-09T05:49:17.927 INFO:teuthology.orchestra.console:Power on for smithi170 completed 2022-07-09T05:49:18.028 INFO:teuthology.provision.fog.smithi170:Waiting for deploy to finish 2022-07-09T05:49:22.102 INFO:teuthology.orchestra.console:Power on for smithi124 completed 2022-07-09T05:49:22.213 INFO:teuthology.provision.fog.smithi124:Waiting for deploy to finish 2022-07-09T05:53:54.559 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-09T05:53:54.860 INFO:teuthology.provision.fog.smithi124:Node is ready 2022-07-09T05:53:54.924 INFO:teuthology.orchestra.run.smithi124.stdout:smithi124.front.sepia.ceph.com 2022-07-09T05:53:55.001 INFO:teuthology.orchestra.run.smithi124.stdout:172.21.15.124 smithi124.front.sepia.ceph.com smithi124 2022-07-09T05:53:55.443 INFO:teuthology.provision.fog.smithi124:Deploy complete! 2022-07-09T05:53:56.367 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-09T05:53:56.648 INFO:teuthology.provision.fog.smithi170:Node is ready 2022-07-09T05:53:56.668 INFO:teuthology.orchestra.run.smithi170.stdout:smithi170.front.sepia.ceph.com 2022-07-09T05:53:56.728 INFO:teuthology.orchestra.run.smithi170.stdout:172.21.15.170 smithi170.front.sepia.ceph.com smithi170 2022-07-09T05:53:57.167 INFO:teuthology.provision.fog.smithi170:Deploy complete! 2022-07-09T05:53:57.525 INFO:teuthology.lock.ops:Checking smithi124.front.sepia.ceph.com 2022-07-09T05:53:57.527 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-09T05:53:57.576 INFO:teuthology.lock.ops:Checking smithi170.front.sepia.ceph.com 2022-07-09T05:53:57.585 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-09T05:53:57.625 INFO:teuthology.lock.ops:Updating [smithi124.front.sepia.ceph.com]: set os type and version on server 2022-07-09T05:53:57.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-07-09T05:53:57.998 INFO:teuthology.orchestra.run.smithi124.stdout:x86_64 2022-07-09T05:53:58.068 INFO:teuthology.orchestra.run.smithi124.stdout:NAME="Red Hat Enterprise Linux" 2022-07-09T05:53:58.068 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION="8.6 (Ootpa)" 2022-07-09T05:53:58.069 INFO:teuthology.orchestra.run.smithi124.stdout:ID="rhel" 2022-07-09T05:53:58.069 INFO:teuthology.orchestra.run.smithi124.stdout:ID_LIKE="fedora" 2022-07-09T05:53:58.069 INFO:teuthology.orchestra.run.smithi124.stdout:VERSION_ID="8.6" 2022-07-09T05:53:58.070 INFO:teuthology.orchestra.run.smithi124.stdout:PLATFORM_ID="platform:el8" 2022-07-09T05:53:58.070 INFO:teuthology.orchestra.run.smithi124.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-09T05:53:58.071 INFO:teuthology.orchestra.run.smithi124.stdout:ANSI_COLOR="0;31" 2022-07-09T05:53:58.071 INFO:teuthology.orchestra.run.smithi124.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-09T05:53:58.071 INFO:teuthology.orchestra.run.smithi124.stdout:HOME_URL="https://www.redhat.com/" 2022-07-09T05:53:58.072 INFO:teuthology.orchestra.run.smithi124.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-09T05:53:58.072 INFO:teuthology.orchestra.run.smithi124.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-09T05:53:58.073 INFO:teuthology.orchestra.run.smithi124.stdout: 2022-07-09T05:53:58.076 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-09T05:53:58.077 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-09T05:53:58.077 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-09T05:53:58.078 INFO:teuthology.orchestra.run.smithi124.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-09T05:53:58.079 INFO:teuthology.lock.ops:Updating smithi124.front.sepia.ceph.com on lock server 2022-07-09T05:53:58.130 INFO:teuthology.lock.ops:Updating [smithi170.front.sepia.ceph.com]: set os type and version on server 2022-07-09T05:53:58.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-07-09T05:53:58.496 INFO:teuthology.orchestra.run.smithi170.stdout:x86_64 2022-07-09T05:53:58.584 INFO:teuthology.orchestra.run.smithi170.stdout:NAME="Red Hat Enterprise Linux" 2022-07-09T05:53:58.585 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION="8.6 (Ootpa)" 2022-07-09T05:53:58.585 INFO:teuthology.orchestra.run.smithi170.stdout:ID="rhel" 2022-07-09T05:53:58.585 INFO:teuthology.orchestra.run.smithi170.stdout:ID_LIKE="fedora" 2022-07-09T05:53:58.586 INFO:teuthology.orchestra.run.smithi170.stdout:VERSION_ID="8.6" 2022-07-09T05:53:58.586 INFO:teuthology.orchestra.run.smithi170.stdout:PLATFORM_ID="platform:el8" 2022-07-09T05:53:58.587 INFO:teuthology.orchestra.run.smithi170.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-07-09T05:53:58.587 INFO:teuthology.orchestra.run.smithi170.stdout:ANSI_COLOR="0;31" 2022-07-09T05:53:58.588 INFO:teuthology.orchestra.run.smithi170.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-07-09T05:53:58.588 INFO:teuthology.orchestra.run.smithi170.stdout:HOME_URL="https://www.redhat.com/" 2022-07-09T05:53:58.589 INFO:teuthology.orchestra.run.smithi170.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-07-09T05:53:58.589 INFO:teuthology.orchestra.run.smithi170.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-09T05:53:58.590 INFO:teuthology.orchestra.run.smithi170.stdout: 2022-07-09T05:53:58.590 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-09T05:53:58.591 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-07-09T05:53:58.591 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-07-09T05:53:58.592 INFO:teuthology.orchestra.run.smithi170.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-07-09T05:53:58.595 INFO:teuthology.lock.ops:Updating smithi170.front.sepia.ceph.com on lock server 2022-07-09T05:53:58.859 INFO:teuthology.dispatcher.supervisor:Running job 6921360 2022-07-09T05:53:58.860 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/bin/teuthology -v --owner scheduled_ksirivad@teuthology --archive /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921360 --name ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921360/orig.config.yaml 2022-07-09T05:53:58.896 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/ksirivad-2022-07-09_05:39:52-rados:thrash-erasure-code-main-distro-default-smithi/6921360 2022-07-09T05:53:58.898 INFO:teuthology.dispatcher.supervisor:Job PID: 13367 2022-07-09T05:53:58.904 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-09T17:55:02.795 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-09T17:55:02.989 INFO:teuthology.kill:Killing Pids: {13367} 2022-07-09T17:55:04.555 INFO:teuthology.task.internal:roles: ubuntu@smithi124.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-09T17:55:04.556 INFO:teuthology.task.internal:roles: ubuntu@smithi170.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-09T17:55:04.557 INFO:teuthology.misc:Compressing logs... 2022-07-09T17:55:04.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi124.front.sepia.ceph.com' 2022-07-09T17:55:04.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi170.front.sepia.ceph.com' 2022-07-09T17:55:05.079 INFO:teuthology.misc:Compressing logs... 2022-07-09T17:55:06.002 INFO:teuthology.orchestra.run.smithi124.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-09T17:55:06.286 INFO:teuthology.orchestra.run.smithi170.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-07-09T17:55:06.928 INFO:teuthology.misc:Compressing logs... 2022-07-09T17:55:14.980 INFO:teuthology.kill:No teuthology processes running 2022-07-09T17:55:16.528 INFO:teuthology.kill:Nuking machines: ['smithi124', 'smithi170'] 2022-07-09T17:55:17.711 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_10062088f503b43eff3624326bda825b23438f9b/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-09T17:55:17.712 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-09T17:55:17.712 INFO:teuthology.kill:2022-07-09 17:55:17,707.707 INFO:teuthology.nuke:targets: 2022-07-09T17:55:17.713 INFO:teuthology.kill: smithi124.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDh1KyhYEiHUXEe+7yXiUpnwGoL+z1M+cYIar/VNG8gXFeG8okpQuK6ddkctCFhzlEXp3MfYbTXRZLnPjl0cRQhTv+b61hzqyGzJzKRtaLtIwk9xS4EzlVUF1z3CPfwauXTQi6LLd2x0IlS94lkf5FLixfsU7FZ7cHTTybiA2MC4qzd0eR0EkpIJTmlp2Nz4eJjCrFPt1+pOXlvk4D10G5y5y8tDXl+dyKtKBujhWlQz1/80lVLvCjJFUnbrOwgI2eZPE35wVzOGTupH5w4hJjCMLMbZm3wn/tuFAO/ttYjK9YDel5Gb3g9w6qy+g4DFvQUH8aYeGGx2FxyHTg73/blUP4WSaWcuMx0HaLtwuISuRYmjWrIo55RCGcbWT/yvViJJJFiDePYgXTmdRpuLJSVfOqaQbKzYNFGvO5IDNddEXo+ZmQMHCkuWz04MRz4+ZzsLEbQSj0Kn9qUiHmonPqdO8RkDBcRwBBECM5G1gn5vDjSrERac8/f0QiS540YF+E= 2022-07-09T17:55:17.713 INFO:teuthology.kill: smithi170.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqFXuSvABnOLJX2v8ZRfMCyde5pofZkaJK6dhkZHnORzC3mJxHBKk/JQEN3hekHE2UhgHMLIg4Erdnec0+cbY0JBQESk81+3TxWIpSRhm/0z6mZIVVvLBzwLtReDrQjw4mXwVftymqdrVgC6oIKik9mXJ4vTUJZIiHd8NJyMP4c+kDTewUxKpRoXiy5DZb04weXznoGGdabdfvlJIexpjJvOCNANjw+S3+VXJf3r5htTXltOnZa16uhpGs/pdqEq7AhxaD/jzKpUHt1RmNEo1sOIQ+iekYwXe9fqX/NQ2VoZVnjNxFgZN2EWQ2+dPesaTSpwKSHmyMCsOh8biwLUnD7+IC9sxCPsOYsvjAntyEF66K+65EQobianpUGo/q48wxPzetQ5tdfm42Jj0Ps4l43d5FGz1PtlVgmA8eAd9Tsb932cJDRbTFlecc/MmOK8Wt5X2Ez2zXipnYJ0RgPue4N/xYqKIQIF+LbRN58cbkSzzujnp9bOK5h9dklEP8iys= 2022-07-09T17:55:17.713 INFO:teuthology.kill:2022-07-09 17:55:17,708.708 INFO:teuthology.nuke:Checking targets against current locks 2022-07-09T17:55:17.779 INFO:teuthology.kill:2022-07-09 17:55:17,778.778 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-09T17:55:17.814 INFO:teuthology.kill:2022-07-09 17:55:17,814.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-09T17:55:17.881 INFO:teuthology.kill:2022-07-09 17:55:17,880.880 INFO:teuthology.orchestra.console:Power off smithi124 2022-07-09T17:55:17.931 INFO:teuthology.kill:2022-07-09 17:55:17,931.931 INFO:teuthology.orchestra.console:Power off smithi170 2022-07-09T17:55:26.298 INFO:teuthology.kill:2022-07-09 17:55:26,297.297 INFO:teuthology.orchestra.console:Power off for smithi170 completed 2022-07-09T17:55:26.454 INFO:teuthology.kill:2022-07-09 17:55:26,453.453 INFO:teuthology.lock.ops:unlocked: smithi170.front.sepia.ceph.com 2022-07-09T17:55:30.374 INFO:teuthology.kill:2022-07-09 17:55:30,374.374 INFO:teuthology.orchestra.console:Power off for smithi124 completed 2022-07-09T17:55:30.529 INFO:teuthology.kill:2022-07-09 17:55:30,529.529 INFO:teuthology.lock.ops:unlocked: smithi124.front.sepia.ceph.com 2022-07-09T17:57:30.947 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-09T17:57:31.083 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi124 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-09_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6921562 2022-07-09T17:57:31.084 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi170 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-07-09_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6921562