2022-04-04T15:14:48.434 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-04T15:14:48.561 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging 2022-04-04T15:14:48.562 INFO:teuthology.lock.ops:Updating [ubuntu@smithi157.front.sepia.ceph.com]: reset os type and version on server 2022-04-04T15:14:48.562 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-04-04T15:14:48.583 INFO:teuthology.lock.ops:Node 'ubuntu@smithi157.front.sepia.ceph.com' reimaging is complete 2022-04-04T15:14:48.584 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging 2022-04-04T15:14:48.585 INFO:teuthology.lock.ops:Updating [ubuntu@smithi163.front.sepia.ceph.com]: reset os type and version on server 2022-04-04T15:14:48.585 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-04T15:14:48.604 INFO:teuthology.lock.ops:Node 'ubuntu@smithi163.front.sepia.ceph.com' reimaging is complete 2022-04-04T15:14:48.814 INFO:teuthology.provision.fog.smithi163:Scheduling deploy of centos 8.stream 2022-04-04T15:14:48.817 INFO:teuthology.provision.fog.smithi157:Scheduling deploy of centos 8.stream 2022-04-04T15:14:49.140 INFO:teuthology.orchestra.console:Power off smithi157 2022-04-04T15:14:49.155 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-04T15:14:57.515 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-04-04T15:14:57.617 INFO:teuthology.orchestra.console:Power on smithi157 2022-04-04T15:15:01.630 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-04T15:15:01.733 INFO:teuthology.orchestra.console:Power on smithi163 2022-04-04T15:15:05.978 INFO:teuthology.orchestra.console:Power on for smithi157 completed 2022-04-04T15:15:05.983 INFO:teuthology.orchestra.console:Power on for smithi163 completed 2022-04-04T15:15:06.080 INFO:teuthology.provision.fog.smithi157:Waiting for deploy to finish 2022-04-04T15:15:06.084 INFO:teuthology.provision.fog.smithi163:Waiting for deploy to finish 2022-04-04T15:19:48.918 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-04T15:20:14.686 INFO:teuthology.provision.fog.smithi157:Node is ready 2022-04-04T15:20:14.706 INFO:teuthology.orchestra.run.smithi157.stdout:smithi157.front.sepia.ceph.com 2022-04-04T15:20:14.764 INFO:teuthology.orchestra.run.smithi157.stdout:172.21.15.157 smithi157.front.sepia.ceph.com smithi157 2022-04-04T15:20:15.131 INFO:teuthology.provision.fog.smithi157:Deploy complete! 2022-04-04T15:20:23.372 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-04T15:20:23.655 INFO:teuthology.provision.fog.smithi163:Node is ready 2022-04-04T15:20:23.672 INFO:teuthology.orchestra.run.smithi163.stdout:smithi163.front.sepia.ceph.com 2022-04-04T15:20:23.730 INFO:teuthology.orchestra.run.smithi163.stdout:172.21.15.163 smithi163.front.sepia.ceph.com smithi163 2022-04-04T15:20:24.086 INFO:teuthology.provision.fog.smithi163:Deploy complete! 2022-04-04T15:20:24.240 INFO:teuthology.lock.ops:Checking smithi157.front.sepia.ceph.com 2022-04-04T15:20:24.241 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-04T15:20:24.259 INFO:teuthology.lock.ops:Checking smithi163.front.sepia.ceph.com 2022-04-04T15:20:24.260 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-04T15:20:24.278 INFO:teuthology.lock.ops:Updating [smithi157.front.sepia.ceph.com]: set os type and version on server 2022-04-04T15:20:24.279 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-04-04T15:20:24.479 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2022-04-04T15:20:24.537 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2022-04-04T15:20:24.538 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="8" 2022-04-04T15:20:24.538 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2022-04-04T15:20:24.538 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2022-04-04T15:20:24.538 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="8" 2022-04-04T15:20:24.539 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el8" 2022-04-04T15:20:24.539 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-04T15:20:24.539 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2022-04-04T15:20:24.539 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-04T15:20:24.540 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2022-04-04T15:20:24.540 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-04T15:20:24.540 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-04T15:20:24.540 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-04T15:20:24.541 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2022-04-04T15:20:24.560 INFO:teuthology.lock.ops:Updating [smithi163.front.sepia.ceph.com]: set os type and version on server 2022-04-04T15:20:24.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-04T15:20:24.746 INFO:teuthology.orchestra.run.smithi163.stdout:x86_64 2022-04-04T15:20:24.802 INFO:teuthology.orchestra.run.smithi163.stdout:NAME="CentOS Stream" 2022-04-04T15:20:24.803 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION="8" 2022-04-04T15:20:24.803 INFO:teuthology.orchestra.run.smithi163.stdout:ID="centos" 2022-04-04T15:20:24.803 INFO:teuthology.orchestra.run.smithi163.stdout:ID_LIKE="rhel fedora" 2022-04-04T15:20:24.803 INFO:teuthology.orchestra.run.smithi163.stdout:VERSION_ID="8" 2022-04-04T15:20:24.804 INFO:teuthology.orchestra.run.smithi163.stdout:PLATFORM_ID="platform:el8" 2022-04-04T15:20:24.804 INFO:teuthology.orchestra.run.smithi163.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-04T15:20:24.804 INFO:teuthology.orchestra.run.smithi163.stdout:ANSI_COLOR="0;31" 2022-04-04T15:20:24.804 INFO:teuthology.orchestra.run.smithi163.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-04T15:20:24.805 INFO:teuthology.orchestra.run.smithi163.stdout:HOME_URL="https://centos.org/" 2022-04-04T15:20:24.805 INFO:teuthology.orchestra.run.smithi163.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-04T15:20:24.805 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-04T15:20:24.805 INFO:teuthology.orchestra.run.smithi163.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-04T15:20:24.806 INFO:teuthology.lock.ops:Updating smithi163.front.sepia.ceph.com on lock server 2022-04-04T15:20:24.900 INFO:teuthology.dispatcher.supervisor:Running job 6774223 2022-04-04T15:20:24.900 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-04-03_01:01:03-crimson-rados-quincy-distro-default-smithi/6774223 --name teuthology-2022-04-03_01:01:03-crimson-rados-quincy-distro-default-smithi --description crimson-rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} centos_latest clusters/{fixed-2} deploy/ceph objectstore/bluestore thrashers/default thrashosds-health workloads/small-objects} -- /home/teuthworker/archive/teuthology-2022-04-03_01:01:03-crimson-rados-quincy-distro-default-smithi/6774223/orig.config.yaml 2022-04-04T15:20:24.904 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-04-03_01:01:03-crimson-rados-quincy-distro-default-smithi/6774223 2022-04-04T15:20:24.905 INFO:teuthology.dispatcher.supervisor:Job PID: 19559 2022-04-04T15:20:24.905 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-04T21:50:53.439 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-04T21:50:53.575 INFO:teuthology.kill:Killing Pids: {19559} 2022-04-04T21:50:54.766 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2022-04-04T21:50:54.767 INFO:teuthology.task.internal:roles: ubuntu@smithi163.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-04T21:50:54.768 INFO:teuthology.misc:Compressing logs... 2022-04-04T21:50:54.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2022-04-04T21:50:54.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi163.front.sepia.ceph.com' 2022-04-04T21:50:55.350 INFO:teuthology.misc:Compressing logs... 2022-04-04T21:50:55.505 INFO:teuthology.misc:Compressing logs... 2022-04-04T21:50:56.693 INFO:teuthology.kill:No teuthology processes running 2022-04-04T21:50:57.797 INFO:teuthology.kill:Nuking machines: ['smithi157', 'smithi163'] 2022-04-04T21:50:58.727 INFO:teuthology.kill:2022-04-04 21:50:58,727.727 INFO:teuthology.nuke:targets: 2022-04-04T21:50:58.728 INFO:teuthology.kill: smithi157.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1LWKHDXNshk7nAyg7cBv8nE4DYtjsObrhK6SsI+xBc2xo2xISRtiETyr5R/hDyOjOmQM/2NCbq4crLTRsRetPNyazuCY5xuLaRQS4q/q4saaYgadTaHPTu8OBfvAHFqlPtNth7K6aoAJ/0ue3oI/Q3PgZQwZmhmcHtLNSj3n5Ky+SsrfUS/m2UjJjYntG38K0lJSrdnMKrC8NJzdln9pMyretuW7n9maqponShGvIN/VL0IHIAbmdXp1SVIGlNkIgXCVYmeBY9wlkYM20afxS9FLmodmFlmAvFr6egfE7h1Nwgm1y04A2BaYJFAjSDLLpHUITB2M0eJkFj28gAZaN5lHwLYQj5JCdlI1c7yNa/WmR4GHRkiahfa1MAQmCd1P4mo2AbPajrYnEa6EmTXPTZeOQwNg3m0fhwSL5b+2k0TcXdCm2rM93Z9c7/4zfLWy300kIbQAVMrpXj9EhaOC9iP4v8j3NR9J+Xgg+JpYvec/CQQicYKH5T25zpirRc3E= 2022-04-04T21:50:58.728 INFO:teuthology.kill: smithi163.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDKlZiadqPhBfuawVhFz+e3xfzDVXU3CEV9ZNfiXRG7FQ1Y7DW2+iRmaSEtebKljl2OsKZf6i9ppbZtwSDQHCfYwk94o5Nlz8AqrHO62RiZua0Kwclx4l5POS6cLWLULLyevmbiE4Qvdese2d1MTj/EoDTjrhAjR0plu3uYymctIwLg6hRp6ze20kRJefQhDOyWBzU72Q9I8juzWifuxh4YlrgrjDC93UW9PFBfb6Bp4nilnNpe+Hm5FfJ0wt7t+ImXQql9RGt8eLh7sHueo9bCxi8VHitYPLo6tkLansV/aRe+WQXx9jmTOozfXNFLYoCasaRQTnKNOSiqknx0NxP3KlfGMKkTgM04AneFvr84hkYt7q8wMl7NNBp+Ozq7xkXzziTaX5n6l1uTp6BaWdpua8dRWCcnxLzM0IvnEl9wr6wnM3J3qd3jv3CT+tD0+Xjdnge4Sux8g58PKl3Wpp8XWpuaVL9m5ff6LQ7EezZ3yyoo2n7ALbRoC9hHW5p2uv8= 2022-04-04T21:50:58.757 INFO:teuthology.kill:2022-04-04 21:50:58,756.756 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-04T21:50:58.759 INFO:teuthology.kill:2022-04-04 21:50:58,759.759 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-04T21:50:58.833 INFO:teuthology.kill:2022-04-04 21:50:58,832.832 INFO:teuthology.orchestra.console:Power off smithi157 2022-04-04T21:50:58.845 INFO:teuthology.kill:2022-04-04 21:50:58,844.844 INFO:teuthology.orchestra.console:Power off smithi163 2022-04-04T21:51:07.205 INFO:teuthology.kill:2022-04-04 21:51:07,204.204 INFO:teuthology.orchestra.console:Power off for smithi157 completed 2022-04-04T21:51:07.210 INFO:teuthology.kill:2022-04-04 21:51:07,210.210 INFO:teuthology.orchestra.console:Power off for smithi163 completed 2022-04-04T21:51:07.356 INFO:teuthology.kill:2022-04-04 21:51:07,355.355 INFO:teuthology.lock.ops:unlocked: smithi157.front.sepia.ceph.com 2022-04-04T21:51:07.358 INFO:teuthology.kill:2022-04-04 21:51:07,357.357 INFO:teuthology.lock.ops:unlocked: smithi163.front.sepia.ceph.com 2022-04-04T21:53:07.654 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-04T21:53:07.749 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi157 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6776585 2022-04-04T21:53:07.749 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi163 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-04_21:46:34-orch-wip-yuri2-testing-2022-03-31-1523-pacific-distro-default-smithi/6776585