2022-06-15T19:07:35.174 INFO:root:teuthology version: 1.1.1.dev370+g2290146e 2022-06-15T19:07:35.400 INFO:teuthology.lock.ops:Start node 'smithi074.front.sepia.ceph.com' reimaging 2022-06-15T19:07:35.403 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-06-15T19:07:35.403 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-06-15T19:07:35.434 INFO:teuthology.lock.ops:Node 'smithi074.front.sepia.ceph.com' reimaging is complete 2022-06-15T19:07:35.435 INFO:teuthology.lock.ops:Start node 'smithi107.front.sepia.ceph.com' reimaging 2022-06-15T19:07:35.435 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-06-15T19:07:35.436 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-06-15T19:07:35.461 INFO:teuthology.lock.ops:Node 'smithi107.front.sepia.ceph.com' reimaging is complete 2022-06-15T19:07:35.681 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.stream 2022-06-15T19:07:35.702 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2022-06-15T19:07:36.166 INFO:teuthology.orchestra.console:Power off smithi107 2022-06-15T19:07:36.190 INFO:teuthology.orchestra.console:Power off smithi074 2022-06-15T19:07:44.570 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-06-15T19:07:44.672 INFO:teuthology.orchestra.console:Power on smithi107 2022-06-15T19:07:48.722 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-06-15T19:07:48.823 INFO:teuthology.orchestra.console:Power on smithi074 2022-06-15T19:07:53.098 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-06-15T19:07:53.202 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-06-15T19:07:57.227 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-06-15T19:07:57.332 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-06-15T19:12:05.198 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-15T19:12:15.510 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-15T19:12:30.322 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-06-15T19:12:30.349 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-06-15T19:12:30.413 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-06-15T19:12:30.815 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-06-15T19:12:40.838 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-06-15T19:12:40.862 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-06-15T19:12:40.924 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-06-15T19:12:41.296 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-06-15T19:12:41.505 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-06-15T19:12:41.507 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-15T19:12:41.538 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-06-15T19:12:41.539 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-15T19:12:41.565 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-06-15T19:12:41.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-06-15T19:12:41.858 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-06-15T19:12:41.918 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Stream" 2022-06-15T19:12:41.919 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8" 2022-06-15T19:12:41.919 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2022-06-15T19:12:41.920 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2022-06-15T19:12:41.921 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8" 2022-06-15T19:12:41.925 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8" 2022-06-15T19:12:41.925 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-15T19:12:41.925 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2022-06-15T19:12:41.926 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-15T19:12:41.926 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/" 2022-06-15T19:12:41.926 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-15T19:12:41.927 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-15T19:12:41.927 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-15T19:12:41.935 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-06-15T19:12:41.955 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-06-15T19:12:41.955 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-06-15T19:12:42.202 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-06-15T19:12:42.260 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2022-06-15T19:12:42.261 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2022-06-15T19:12:42.261 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2022-06-15T19:12:42.261 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2022-06-15T19:12:42.262 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2022-06-15T19:12:42.263 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2022-06-15T19:12:42.264 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-15T19:12:42.264 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2022-06-15T19:12:42.265 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-15T19:12:42.265 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2022-06-15T19:12:42.266 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-15T19:12:42.266 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-15T19:12:42.267 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-15T19:12:42.268 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-06-15T19:12:42.410 INFO:teuthology.dispatcher.supervisor:Running job 6881131 2022-06-15T19:12:42.411 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_2290146eac7577b8500f128a53856c3ea4a00e3c/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-06-15_18:29:33-rados-wip-yuri4-testing-2022-06-15-1000-pacific-distro-default-smithi/6881131 --name yuriw-2022-06-15_18:29:33-rados-wip-yuri4-testing-2022-06-15-1000-pacific-distro-default-smithi --description rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} -- /home/teuthworker/archive/yuriw-2022-06-15_18:29:33-rados-wip-yuri4-testing-2022-06-15-1000-pacific-distro-default-smithi/6881131/orig.config.yaml 2022-06-15T19:12:42.417 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-06-15_18:29:33-rados-wip-yuri4-testing-2022-06-15-1000-pacific-distro-default-smithi/6881131 2022-06-15T19:12:42.419 INFO:teuthology.dispatcher.supervisor:Job PID: 16233 2022-06-15T19:12:42.419 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-16T07:13:54.746 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-16T07:13:54.907 INFO:teuthology.kill:Killing Pids: {16233} 2022-06-16T07:13:57.172 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-16T07:13:57.173 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-16T07:13:57.173 INFO:teuthology.misc:Compressing logs... 2022-06-16T07:13:57.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-06-16T07:13:57.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-06-16T07:13:57.696 INFO:teuthology.misc:Compressing logs... 2022-06-16T07:13:58.674 INFO:teuthology.orchestra.run.smithi107.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-16T07:13:58.931 INFO:teuthology.orchestra.run.smithi074.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-16T07:13:59.592 INFO:teuthology.misc:Compressing logs... 2022-06-16T07:14:01.653 INFO:teuthology.kill:No teuthology processes running 2022-06-16T07:14:03.137 INFO:teuthology.kill:Nuking machines: ['smithi074', 'smithi107'] 2022-06-16T07:14:04.296 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_2290146eac7577b8500f128a53856c3ea4a00e3c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-16T07:14:04.298 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-16T07:14:04.298 INFO:teuthology.kill:2022-06-16 07:14:04,295.295 INFO:teuthology.nuke:targets: 2022-06-16T07:14:04.298 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg5lna5TByt90j/itgiM+Emaz7buARXy+/XrF/IKDwk1MIPZLGxF93n/6EL2V3pfB1fBWcVcNkSRwWqpoqWyzKqRtVLzYMXz72VuS/OnYtdqX+zTcE5pm8kscK3fu+m+C9yxLSOgLcUeMdsn8tCLrvoVK1YDt0PcerPJJKgFySYH2bLFWUey+CnbaFRiUgbXNOuhs5rbEYWkAEND0Mk9y4pEkyk+HSid7Yd0db5A6I+zz5MLgogBP1Kl7VdEpFKcXRlI1cL0+UBajvYBPPw+y98IxXMEHeuCO0lOMN33vbV/D/KAVR1QOrPxQSGEJ14Be/EAltzaciCuCgY5W83z2xczgRICMKtQ0DskUjAhDKo2IprA0iXPDHq9KAOf6UT0N8RvHNCssbn7DGA6jWx/1VOu8Nw2AmDkZVnQ8gPeflrECpMlntQ5thkxkPI/5esXe8uONdYY+USmaZc4enoXfSwrMqbp9hrBCr2AJ/RIoER5eMskdLtUoh+xTt5xzgsW8= 2022-06-16T07:14:04.298 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCtsZ8u8SzE9g9RG/Wp2RofTpmn5pp4TDZafMtpMJlBmbPS+alPwxV00GrVRf4Pg2X7fcQwVZBZJ+uQ7VCZ6t61SArURRyrbK+sp6zLyHuD4HFV7a97AYkl6Dt4ffEnOo5pzZag/RKHZk0use4bUFv8OpnknOXggqp/KcSSB3BomU5I6KXIAnbVmb2gKOkCCjpgGyLLYMmSn8OgpJB9ZJmObzZ2epdmzyhJsT1g47UrRi9oU+2ZwThnbZNn4ngH7rsDqiC7q5wWfPXh1YzOFOI1pbnpwqFIkV4cbjOlrYAKhC7tzOLDaKkIOUb6yWnQbdXViAgmM9ahzoGvtbKl/gdFs8f1CG/IiUGCQlLgZn2JGuNn+/h79gLFt6jkn7xBw15VNNEZJSPCpPaHagJS/gsisRoaRxLfbQ4HRfHMgokBkkdwN9iPnPld9gyNb6McKY3XiF80mUD0WcE/D2QEbLpWpmLbyaQ3oLPuMdBOwNUKmw/YK4/cjDyVt/0xQT0p+f8= 2022-06-16T07:14:04.326 INFO:teuthology.kill:2022-06-16 07:14:04,325.325 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-16T07:14:04.329 INFO:teuthology.kill:2022-06-16 07:14:04,329.329 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-16T07:14:04.428 INFO:teuthology.kill:2022-06-16 07:14:04,428.428 INFO:teuthology.orchestra.console:Power off smithi074 2022-06-16T07:14:04.443 INFO:teuthology.kill:2022-06-16 07:14:04,443.443 INFO:teuthology.orchestra.console:Power off smithi107 2022-06-16T07:14:12.810 INFO:teuthology.kill:2022-06-16 07:14:12,809.809 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-06-16T07:14:12.964 INFO:teuthology.kill:2022-06-16 07:14:12,964.964 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-06-16T07:14:16.915 INFO:teuthology.kill:2022-06-16 07:14:16,914.914 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-06-16T07:14:17.078 INFO:teuthology.kill:2022-06-16 07:14:17,078.078 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-06-16T07:16:17.509 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15