2022-09-04T14:37:56.022 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-04T14:37:56.245 INFO:teuthology.lock.ops:Start node 'smithi105.front.sepia.ceph.com' reimaging 2022-09-04T14:37:56.247 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T14:37:56.247 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-09-04T14:37:56.268 INFO:teuthology.lock.ops:Node 'smithi105.front.sepia.ceph.com' reimaging is complete 2022-09-04T14:37:56.269 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2022-09-04T14:37:56.269 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2022-09-04T14:37:56.269 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-09-04T14:37:56.296 INFO:teuthology.lock.ops:Node 'smithi153.front.sepia.ceph.com' reimaging is complete 2022-09-04T14:37:56.481 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.stream 2022-09-04T14:37:56.507 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2022-09-04T14:37:56.806 INFO:teuthology.orchestra.console:Power off smithi105 2022-09-04T14:37:56.828 INFO:teuthology.orchestra.console:Power off smithi153 2022-09-04T14:37:56.960 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-09-04T14:37:56.970 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-09-04T14:37:57.063 INFO:teuthology.orchestra.console:Power on smithi105 2022-09-04T14:37:57.072 INFO:teuthology.orchestra.console:Power on smithi153 2022-09-04T14:38:01.327 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2022-09-04T14:38:01.428 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2022-09-04T14:38:05.444 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2022-09-04T14:38:05.545 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2022-09-04T14:42:48.153 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T14:42:48.440 INFO:teuthology.provision.fog.smithi105:Node is ready 2022-09-04T14:42:48.458 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2022-09-04T14:42:48.516 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2022-09-04T14:42:48.863 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2022-09-04T14:42:52.075 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-04T14:42:52.339 INFO:teuthology.provision.fog.smithi153:Node is ready 2022-09-04T14:42:52.357 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2022-09-04T14:42:52.415 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2022-09-04T14:42:52.757 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2022-09-04T14:42:52.941 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2022-09-04T14:42:52.942 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T14:42:52.966 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2022-09-04T14:42:52.966 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-04T14:42:52.986 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2022-09-04T14:42:52.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-09-04T14:42:53.192 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2022-09-04T14:42:53.250 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Stream" 2022-09-04T14:42:53.251 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8" 2022-09-04T14:42:53.251 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2022-09-04T14:42:53.251 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2022-09-04T14:42:53.251 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2022-09-04T14:42:53.252 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2022-09-04T14:42:53.252 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-04T14:42:53.252 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2022-09-04T14:42:53.252 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-04T14:42:53.253 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://centos.org/" 2022-09-04T14:42:53.253 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-04T14:42:53.253 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-04T14:42:53.253 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-04T14:42:53.256 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2022-09-04T14:42:53.277 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2022-09-04T14:42:53.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-09-04T14:42:53.492 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2022-09-04T14:42:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2022-09-04T14:42:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2022-09-04T14:42:53.549 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2022-09-04T14:42:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2022-09-04T14:42:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2022-09-04T14:42:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2022-09-04T14:42:53.550 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-04T14:42:53.551 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2022-09-04T14:42:53.551 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-04T14:42:53.551 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2022-09-04T14:42:53.551 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-04T14:42:53.552 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-04T14:42:53.552 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-04T14:42:53.552 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-09-04T14:42:53.655 INFO:teuthology.dispatcher.supervisor:Running job 7004683 2022-09-04T14:42:53.655 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004683 --name benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004683/orig.config.yaml 2022-09-04T14:42:53.660 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:54:32-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004683 2022-09-04T14:42:53.661 INFO:teuthology.dispatcher.supervisor:Job PID: 28893 2022-09-04T14:42:53.661 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-05T02:43:51.831 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-05T02:43:52.016 INFO:teuthology.kill:Killing Pids: {28893} 2022-09-05T02:43:53.464 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-05T02:43:53.465 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-05T02:43:53.465 INFO:teuthology.misc:Compressing logs... 2022-09-05T02:43:53.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi105.front.sepia.ceph.com' 2022-09-05T02:43:53.664 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-09-05T02:43:54.165 INFO:teuthology.misc:Compressing logs... 2022-09-05T02:43:55.316 INFO:teuthology.orchestra.run.smithi105.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-05T02:43:55.330 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-05T02:45:54.109 INFO:teuthology.misc:Compressing logs... 2022-09-05T02:45:57.096 INFO:teuthology.kill:No teuthology processes running 2022-09-05T02:45:58.557 INFO:teuthology.kill:Nuking machines: ['smithi105', 'smithi153'] 2022-09-05T02:45:59.810 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-05T02:45:59.811 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-05T02:45:59.811 INFO:teuthology.kill:2022-09-05 02:45:59,809.809 INFO:teuthology.nuke:targets: 2022-09-05T02:45:59.811 INFO:teuthology.kill: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqAU/whAPfA/HNUn9cOosE/mAQ7rPnz/NezoZLikAndjYWiwuwXbLDZaySklnvKCx5N8vqsMyO4pX3ysRpOK0YNBSySK/cFlpIikpTrVnwJ9mItU2HndaRyjT8ZpA+Zu7SKdOY+2jcFg5iCt2HRN/iJX0PMzNrp6GmHNMPBX5BpVZ1N7X2RBklaFySSYBeWskQI2wHtoJyTjSq0mfpDstZ6PJVMl61j9j+Zq9vNUgsbYfusiQq/qGnBw0hNJYczP3EqVB/vJAtbtVqOOG/tSjAnfVPTugibKY0KcxUYGFtpZbiAYNhOJyCPozfYPysJyeaV8N6GPufVfUB0RUFXhz9W02mnmpZE936jv1I6rwFQMsH6oha3VdRDfMx+XWHOoYz8ElKBBx/D7gQVEzo3K5aY6GEqdq/ZGNf8fXP0HrhQ39MGOi5QFdjg+V62vZiGF2UCSc+G+Z969Mo8JZwNJDwjA4cjIVkpYoqSZcMj/81q2VT+PluITxoCsfb9Ji1LOc= 2022-09-05T02:45:59.812 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCuWpKXigiaXwdwQ5zP2o7aCtAAektaET2BPH5cFpVRnEm03VraiZNK0W221O5IlPkDLb+0R3KOcFxvlNgOKvWx31n6scYzSadWijlaC3yAmM6fwjmRexnjLEmhksvFr94ccrk4zlTnq1yKKQlF66WQ58ibVFVV6GxidE8HxJXh7Fm/osQEBCsSqAgUXHYsHV2MpdpeCfJYXDfjWVO6oG4tor34mdM6dOsUT7s5cCpi4THVbyvzeivOFUsgy4D5iJoM2RzJYvm5PDknTO554FYLIjhiEbplqbbnngi6ucdNLI5zM5hr+jKgglARN1nbOIuwSxIbrE5+D8NGEVPZ0yrJH7vGaN52emZ/cqhMHyjcJbUGNk8iVrYgePEN+Rv8sNe/ZS38UcNT2AfxtqccFWyBXKGySUBtVtk1JA0rpGuzpSeNkd/+YXlkkubpBVzZMekxR0RC/I0+tvW+L9GaquQ+vtfAi5JMrktvXNo5iPBPuTWgOUskn8kPvjzxoOjCiNU= 2022-09-05T02:45:59.812 INFO:teuthology.kill:2022-09-05 02:45:59,810.810 INFO:teuthology.nuke:Checking targets against current locks 2022-09-05T02:45:59.866 INFO:teuthology.kill:2022-09-05 02:45:59,866.866 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-05T02:45:59.892 INFO:teuthology.kill:2022-09-05 02:45:59,891.891 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-05T02:45:59.950 INFO:teuthology.kill:2022-09-05 02:45:59,949.949 INFO:teuthology.orchestra.console:Power off smithi105 2022-09-05T02:45:59.984 INFO:teuthology.kill:2022-09-05 02:45:59,983.983 INFO:teuthology.orchestra.console:Power off smithi153 2022-09-05T02:46:12.433 INFO:teuthology.kill:2022-09-05 02:46:12,432.432 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2022-09-05T02:46:12.460 INFO:teuthology.kill:2022-09-05 02:46:12,460.460 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-09-05T02:46:12.585 INFO:teuthology.kill:2022-09-05 02:46:12,584.584 INFO:teuthology.lock.ops:unlocked: smithi105.front.sepia.ceph.com 2022-09-05T02:46:12.606 INFO:teuthology.kill:2022-09-05 02:46:12,606.606 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2022-09-05T02:48:12.917 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-05T02:48:13.026 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi105 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-04_23:15:18-rbd-wip-yuri10-testing-2022-09-04-0811-quincy-distro-default-smithi/7011401 2022-09-05T02:48:13.027 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-04_23:15:18-rbd-wip-yuri10-testing-2022-09-04-0811-quincy-distro-default-smithi/7011401