2022-09-01T11:52:09.224 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-01T11:52:09.432 INFO:teuthology.lock.ops:Start node 'smithi045.front.sepia.ceph.com' reimaging 2022-09-01T11:52:09.434 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: reset os type and version on server 2022-09-01T11:52:09.435 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-09-01T11:52:09.484 INFO:teuthology.lock.ops:Node 'smithi045.front.sepia.ceph.com' reimaging is complete 2022-09-01T11:52:09.484 INFO:teuthology.lock.ops:Start node 'smithi055.front.sepia.ceph.com' reimaging 2022-09-01T11:52:09.486 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: reset os type and version on server 2022-09-01T11:52:09.486 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-01T11:52:09.522 INFO:teuthology.lock.ops:Node 'smithi055.front.sepia.ceph.com' reimaging is complete 2022-09-01T11:52:09.740 INFO:teuthology.provision.fog.smithi045:Scheduling deploy of centos 8.stream 2022-09-01T11:52:09.763 INFO:teuthology.provision.fog.smithi055:Scheduling deploy of centos 8.stream 2022-09-01T11:52:10.151 INFO:teuthology.orchestra.console:Power off smithi045 2022-09-01T11:52:10.173 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-01T11:52:18.563 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2022-09-01T11:52:18.571 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-01T11:52:18.666 INFO:teuthology.orchestra.console:Power on smithi045 2022-09-01T11:52:18.680 INFO:teuthology.orchestra.console:Power on smithi055 2022-09-01T11:52:27.071 INFO:teuthology.orchestra.console:Power on for smithi045 completed 2022-09-01T11:52:27.105 INFO:teuthology.orchestra.console:Power on for smithi055 completed 2022-09-01T11:52:27.175 INFO:teuthology.provision.fog.smithi045:Waiting for deploy to finish 2022-09-01T11:52:27.206 INFO:teuthology.provision.fog.smithi055:Waiting for deploy to finish 2022-09-01T11:56:09.409 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-01T11:56:29.642 INFO:teuthology.provision.fog.smithi055:Node is ready 2022-09-01T11:56:29.670 INFO:teuthology.orchestra.run.smithi055.stdout:smithi055.front.sepia.ceph.com 2022-09-01T11:56:29.731 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55 smithi055.front.sepia.ceph.com smithi055 2022-09-01T11:56:30.096 INFO:teuthology.provision.fog.smithi055:Deploy complete! 2022-09-01T11:56:34.863 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-01T11:56:35.162 INFO:teuthology.provision.fog.smithi045:Node is ready 2022-09-01T11:56:35.182 INFO:teuthology.orchestra.run.smithi045.stdout:smithi045.front.sepia.ceph.com 2022-09-01T11:56:35.243 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45 smithi045.front.sepia.ceph.com smithi045 2022-09-01T11:56:35.596 INFO:teuthology.provision.fog.smithi045:Deploy complete! 2022-09-01T11:56:35.789 INFO:teuthology.lock.ops:Checking smithi045.front.sepia.ceph.com 2022-09-01T11:56:35.792 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-01T11:56:35.819 INFO:teuthology.lock.ops:Checking smithi055.front.sepia.ceph.com 2022-09-01T11:56:35.819 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-01T11:56:35.849 INFO:teuthology.lock.ops:Updating [smithi045.front.sepia.ceph.com]: set os type and version on server 2022-09-01T11:56:35.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2022-09-01T11:56:36.030 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2022-09-01T11:56:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2022-09-01T11:56:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="8" 2022-09-01T11:56:36.090 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2022-09-01T11:56:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2022-09-01T11:56:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="8" 2022-09-01T11:56:36.091 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el8" 2022-09-01T11:56:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-01T11:56:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2022-09-01T11:56:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-01T11:56:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2022-09-01T11:56:36.092 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-01T11:56:36.093 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-01T11:56:36.093 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-01T11:56:36.094 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2022-09-01T11:56:36.115 INFO:teuthology.lock.ops:Updating [smithi055.front.sepia.ceph.com]: set os type and version on server 2022-09-01T11:56:36.115 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-01T11:56:36.348 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-09-01T11:56:36.407 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="CentOS Stream" 2022-09-01T11:56:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8" 2022-09-01T11:56:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:ID="centos" 2022-09-01T11:56:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="rhel fedora" 2022-09-01T11:56:36.408 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8" 2022-09-01T11:56:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-09-01T11:56:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-01T11:56:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-09-01T11:56:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-01T11:56:36.409 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://centos.org/" 2022-09-01T11:56:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-01T11:56:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-01T11:56:36.410 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-01T11:56:36.411 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-01T11:56:36.536 INFO:teuthology.dispatcher.supervisor:Running job 7004115 2022-09-01T11:56:36.537 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_benhanokh@teuthology --archive /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004115 --name benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} -- /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004115/orig.config.yaml 2022-09-01T11:56:36.541 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/benhanokh-2022-09-01_10:32:47-rados-WIP_GBH_snap_mapper_one_way-distro-default-smithi/7004115 2022-09-01T11:56:36.543 INFO:teuthology.dispatcher.supervisor:Job PID: 27678 2022-09-01T11:56:36.543 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-01T23:57:35.918 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-01T23:57:36.132 INFO:teuthology.kill:Killing Pids: {27678} 2022-09-01T23:57:37.773 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-09-01T23:57:37.774 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-01T23:57:37.774 INFO:teuthology.misc:Compressing logs... 2022-09-01T23:57:37.775 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2022-09-01T23:57:37.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-01T23:57:38.463 INFO:teuthology.misc:Compressing logs... 2022-09-01T23:57:39.648 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-01T23:57:39.669 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-09-02T00:00:10.768 INFO:teuthology.misc:Compressing logs... 2022-09-02T00:00:18.642 INFO:teuthology.kill:No teuthology processes running 2022-09-02T00:00:20.140 INFO:teuthology.kill:Nuking machines: ['smithi045', 'smithi055'] 2022-09-02T00:00:21.817 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-02T00:00:21.818 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-02T00:00:21.818 INFO:teuthology.kill:2022-09-02 00:00:21,817.817 INFO:teuthology.nuke:targets: 2022-09-02T00:00:21.819 INFO:teuthology.kill: smithi045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu86cinkrY+0BLd+i88kokar/dQ+xavNpQnEwqrdoDvAaNxmET4POYfy73+s85AYx4aaAF7/LakNcGm51x/8gW42G5odSUNMGxJ87mlfGqBzLPpQBn8XPbVZAchdzOkIdy/pQDEED0Ng60PepvBt6o5Qgx8fHNqAX24vfmvtuoLC8gdPV4ysQVKNURZ6aSqFLNtlOSdspZBKYgJKBlhE4H3iQnlPBLTndM71eW4Yn1C5YpePOG1GrYfxJCmGNUhDQj0mneESWD8LqiTz8GefIaHH6sQKY9fAfihh2uv6LWlnVa5bLjmblV8jbaV8JxJ07gGHeRkkrd4GiGMod68lajulrElfeXAFd+iwvHSOGTkVsmeKPbq2ywud1Mi7y65N2CsoltMbVaMo0VMdzbKOU0bkp24JlMiUr7jhDGcv0XiHnS3Q8N2YxDngCqAc0na7XojZ+/1t5l4guebimTlU0eYkBCaOOB85XDOzq/0/32KVUdP1yeFT2imIF23ZQFKE0= 2022-09-02T00:00:21.819 INFO:teuthology.kill: smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZhrAB2uOOyMnJFEYDJYEl4KKAFIkia3TrvL+xm0SeNQ0hU/6OidVI/YcUxtryCHpC4Bw7116vVcWkAA/dSOTmkN/UxQDuKAnUo2NQjULj1B6lf4+wO+a9S1u/g9ZxhdMGSvCQwYrQARsHYFRPKVxvew7rFJ2cqVTHd0dGb3aCN+gSZe0k9Llp2d5D1TRu1YeA5jrtkKzPyLx2y9iX9bIBoJ59oY1odvcF23VxpoOM4r5dDCi0/ZuoEYVe9ZibK7NBc90DCxH6Wli2zu9m5m3crVJxyGjwZDLwWoA0Xzgpx7dgWQITtva7Y7pVA7hWe4HzmoImzbV6ibmuLZdosApwF81FeS/NmW6phloWLDm7q+EZJ2s61qJERSuBK3U/kcMKWvMlpdDp1l3Yuq1UyZDBDI99eV7YD6CcM3Eo4+RHXWlTXDVJTfXAShnJS1NaI1ixtrrwPvDunDKSifBv+e+hx4149faD4jeXtcYSws/XGTCGLODRv8i/9iXChzyGQgk= 2022-09-02T00:00:21.819 INFO:teuthology.kill:2022-09-02 00:00:21,817.817 INFO:teuthology.nuke:Checking targets against current locks 2022-09-02T00:00:21.873 INFO:teuthology.kill:2022-09-02 00:00:21,873.873 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-02T00:00:21.901 INFO:teuthology.kill:2022-09-02 00:00:21,901.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-02T00:00:21.981 INFO:teuthology.kill:2022-09-02 00:00:21,981.981 INFO:teuthology.orchestra.console:Power off smithi045 2022-09-02T00:00:22.024 INFO:teuthology.kill:2022-09-02 00:00:22,024.024 INFO:teuthology.orchestra.console:Power off smithi055 2022-09-02T00:00:30.379 INFO:teuthology.kill:2022-09-02 00:00:30,378.378 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2022-09-02T00:00:30.537 INFO:teuthology.kill:2022-09-02 00:00:30,536.536 INFO:teuthology.lock.ops:unlocked: smithi045.front.sepia.ceph.com 2022-09-02T00:00:34.507 INFO:teuthology.kill:2022-09-02 00:00:34,507.507 INFO:teuthology.orchestra.console:Power off for smithi055 completed 2022-09-02T00:00:34.673 INFO:teuthology.kill:2022-09-02 00:00:34,672.672 INFO:teuthology.lock.ops:unlocked: smithi055.front.sepia.ceph.com 2022-09-02T00:02:35.145 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-02T00:02:35.306 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi045 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:33:38-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7005924 2022-09-02T00:02:35.306 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi055 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-01_20:33:38-rados-wip-yuri6-testing-2022-09-01-1034-quincy-distro-default-smithi/7005921