2022-09-11T11:36:17.023 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-11T11:36:17.175 INFO:teuthology.lock.ops:Start node 'smithi032.front.sepia.ceph.com' reimaging 2022-09-11T11:36:17.176 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: reset os type and version on server 2022-09-11T11:36:17.176 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2022-09-11T11:36:17.198 INFO:teuthology.lock.ops:Node 'smithi032.front.sepia.ceph.com' reimaging is complete 2022-09-11T11:36:17.199 INFO:teuthology.lock.ops:Start node 'smithi156.front.sepia.ceph.com' reimaging 2022-09-11T11:36:17.199 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: reset os type and version on server 2022-09-11T11:36:17.200 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-09-11T11:36:17.220 INFO:teuthology.lock.ops:Node 'smithi156.front.sepia.ceph.com' reimaging is complete 2022-09-11T11:36:17.412 INFO:teuthology.provision.fog.smithi032:Scheduling deploy of centos 8.stream 2022-09-11T11:36:17.443 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream 2022-09-11T11:36:17.765 INFO:teuthology.orchestra.console:Power off smithi032 2022-09-11T11:36:17.820 INFO:teuthology.orchestra.console:Power off smithi156 2022-09-11T11:36:26.156 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2022-09-11T11:36:26.191 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-09-11T11:36:26.258 INFO:teuthology.orchestra.console:Power on smithi032 2022-09-11T11:36:26.293 INFO:teuthology.orchestra.console:Power on smithi156 2022-09-11T11:36:34.630 INFO:teuthology.orchestra.console:Power on for smithi032 completed 2022-09-11T11:36:34.666 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2022-09-11T11:36:34.732 INFO:teuthology.provision.fog.smithi032:Waiting for deploy to finish 2022-09-11T11:36:34.767 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2022-09-11T11:38:50.915 ERROR:teuthology.orchestra.connection:Error authenticating with smithi032.front.sepia.ceph.com: Authentication failed. 2022-09-11T11:40:13.569 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-11T11:40:39.816 INFO:teuthology.provision.fog.smithi032:Node is ready 2022-09-11T11:40:39.841 INFO:teuthology.orchestra.run.smithi032.stdout:smithi032.front.sepia.ceph.com 2022-09-11T11:40:39.903 INFO:teuthology.orchestra.run.smithi032.stdout:172.21.15.32 smithi032.front.sepia.ceph.com smithi032 2022-09-11T11:40:40.279 INFO:teuthology.provision.fog.smithi032:Deploy complete! 2022-09-11T11:41:30.611 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-09-11T11:41:30.892 INFO:teuthology.provision.fog.smithi156:Node is ready 2022-09-11T11:41:30.912 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2022-09-11T11:41:30.972 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2022-09-11T11:41:31.326 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2022-09-11T11:41:31.599 INFO:teuthology.lock.ops:Checking smithi032.front.sepia.ceph.com 2022-09-11T11:41:31.600 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-11T11:41:31.620 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2022-09-11T11:41:31.620 INFO:teuthology.lock.ops:New key found. Updating... 2022-09-11T11:41:31.639 INFO:teuthology.lock.ops:Updating [smithi032.front.sepia.ceph.com]: set os type and version on server 2022-09-11T11:41:31.639 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2022-09-11T11:41:31.885 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2022-09-11T11:41:31.944 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="CentOS Stream" 2022-09-11T11:41:31.945 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="8" 2022-09-11T11:41:31.945 INFO:teuthology.orchestra.run.smithi032.stdout:ID="centos" 2022-09-11T11:41:31.946 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE="rhel fedora" 2022-09-11T11:41:31.946 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="8" 2022-09-11T11:41:31.947 INFO:teuthology.orchestra.run.smithi032.stdout:PLATFORM_ID="platform:el8" 2022-09-11T11:41:31.947 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-11T11:41:31.947 INFO:teuthology.orchestra.run.smithi032.stdout:ANSI_COLOR="0;31" 2022-09-11T11:41:31.947 INFO:teuthology.orchestra.run.smithi032.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-11T11:41:31.948 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://centos.org/" 2022-09-11T11:41:31.948 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-11T11:41:31.948 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-11T11:41:31.948 INFO:teuthology.orchestra.run.smithi032.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-11T11:41:31.950 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2022-09-11T11:41:31.969 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2022-09-11T11:41:31.969 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-09-11T11:41:32.126 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2022-09-11T11:41:32.183 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2022-09-11T11:41:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2022-09-11T11:41:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2022-09-11T11:41:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2022-09-11T11:41:32.184 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2022-09-11T11:41:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2022-09-11T11:41:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-11T11:41:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2022-09-11T11:41:32.185 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-11T11:41:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2022-09-11T11:41:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-11T11:41:32.186 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-11T11:41:32.187 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-11T11:41:32.187 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-09-11T11:41:32.298 INFO:teuthology.dispatcher.supervisor:Running job 7026142 2022-09-11T11:41:32.298 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_matan@teuthology --archive /home/teuthworker/archive/matan-2022-09-11_11:21:46-crimson-rados:thrash-main-distro-crimson-smithi/7026142 --name matan-2022-09-11_11:21:46-crimson-rados:thrash-main-distro-crimson-smithi --description crimson-rados:thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/snaps-few-objects} -- /home/teuthworker/archive/matan-2022-09-11_11:21:46-crimson-rados:thrash-main-distro-crimson-smithi/7026142/orig.config.yaml 2022-09-11T11:41:32.306 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/matan-2022-09-11_11:21:46-crimson-rados:thrash-main-distro-crimson-smithi/7026142 2022-09-11T11:41:32.306 INFO:teuthology.dispatcher.supervisor:Job PID: 26012 2022-09-11T11:41:32.307 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-09-11T23:41:54.209 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-09-11T23:41:54.344 INFO:teuthology.kill:Killing Pids: {26012} 2022-09-11T23:41:55.691 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2022-09-11T23:41:55.692 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-09-11T23:41:55.693 INFO:teuthology.misc:Compressing logs... 2022-09-11T23:41:55.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2022-09-11T23:41:55.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-09-11T23:41:56.213 INFO:teuthology.misc:Compressing logs... 2022-09-11T23:41:56.362 INFO:teuthology.misc:Compressing logs... 2022-09-11T23:41:59.790 INFO:teuthology.kill:No teuthology processes running 2022-09-11T23:42:01.151 INFO:teuthology.kill:Nuking machines: ['smithi032', 'smithi156'] 2022-09-11T23:42:02.320 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-09-11T23:42:02.321 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-09-11T23:42:02.321 INFO:teuthology.kill:2022-09-11 23:42:02,320.320 INFO:teuthology.nuke:targets: 2022-09-11T23:42:02.322 INFO:teuthology.kill: smithi032.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDoFsVzaXdJYJ+qc8llvk4hKceVZekbQ9JNFddf4g5Azik4ItmCd8x9fJ1lJUc1jyjSgb9JmUqAOFaQvoguvibG2Lv82hBS0QzxJW+6ZukjqUkLU4i54GHnHpAtPr1GiVppnW13ApxGZkhp8HoUUT5gKIFwNhh9uSsCXeBjbmMzAAQHuW5bWUdwsDQjiXxFk77H+x/CyfxDIz2v/ZPLvlYk47RqOmHVfDnXjbzfSIEO/Am4C7nxe1YY5mNo4nG03ARhuEW3ebQHqsrvD/0SVyjT10FU7H9PNa55/Rwxx3ampIA/Mn41hn3PZ2CeFstdROOSOFLPSyPGswYcO5tBf+S75ExYdtA+WTY826SVAr34Yk+gzBR95Smg9gupeeHtYsFD4HVy9P8ooF5glgiGNzC9bhuM2AYH6O+/xad11OOo4CrVhsE/+kIP9Ykjh2rMDS11f9I3IqjoEGHyppG0RLBDSnm/YpzoheYQ5Rkn7OISpQXZy04M8gZvJu4Y0a0M4ik= 2022-09-11T23:42:02.322 INFO:teuthology.kill: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC18BTTgAOOPYCGes7Xt7qL+IX95cLum64j/Q60LloAknZ57D22tlF4Gi0OTbVlYkgYUhqmmY54hc9LBAQlzScMz2W8UVrHsNrwctbBC2Ma/Pj8NEICyV7BG4cJ6blPbjrWHWFFar/PMc/8idmi5Qne5twtQNIPq9kbwwKi0gsKMvZ3Gomht9W6bZqN9TroK1MlYGQVjKaiZf8nDKy9lXzuI4IcLEKX/eM26y7e5opI5MTaaxb7dntyGOTMJ8mSo4V11Fg4ZClG27gKjuFPKYK2YmyBxZhonxuCsteUYrAKJlszLmMKCea0bprBRy+6NI0BlxFvGAPuxDowPFv7sbqKefoxNPbMqQo7hd/Luxqo9x5f7rAz7Fe6K5KWkP7B5Ky4KJ24o1KGso+0OKPQX/jdJ4ICVVqgGiXsLVUDIzbw6tdTcP05H3jtCZMVGp5kWFAaCnfXV4Z3gPe49zJynGOUy2Z8AZIlmAawhoPlG/hn2qnt8kOMskxkUaCK/YIP6CE= 2022-09-11T23:42:02.322 INFO:teuthology.kill:2022-09-11 23:42:02,320.320 INFO:teuthology.nuke:Checking targets against current locks 2022-09-11T23:42:02.372 INFO:teuthology.kill:2022-09-11 23:42:02,371.371 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-11T23:42:02.405 INFO:teuthology.kill:2022-09-11 23:42:02,405.405 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-11T23:42:02.454 INFO:teuthology.kill:2022-09-11 23:42:02,453.453 INFO:teuthology.orchestra.console:Power off smithi032 2022-09-11T23:42:02.491 INFO:teuthology.kill:2022-09-11 23:42:02,490.490 INFO:teuthology.orchestra.console:Power off smithi156 2022-09-11T23:42:10.826 INFO:teuthology.kill:2022-09-11 23:42:10,825.825 INFO:teuthology.orchestra.console:Power off for smithi032 completed 2022-09-11T23:42:10.858 INFO:teuthology.kill:2022-09-11 23:42:10,858.858 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-09-11T23:42:10.977 INFO:teuthology.kill:2022-09-11 23:42:10,977.977 INFO:teuthology.lock.ops:unlocked: smithi032.front.sepia.ceph.com 2022-09-11T23:42:11.003 INFO:teuthology.kill:2022-09-11 23:42:11,003.003 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2022-09-11T23:44:11.226 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-09-11T23:44:11.322 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi032 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-11_20:15:10-fs-main-distro-default-smithi/7026356 2022-09-11T23:44:11.323 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-09-11_20:15:10-fs-main-distro-default-smithi/7026356