2022-03-11T02:18:34.046 INFO:root:teuthology version: 1.1.0-ff5db916 2022-03-11T02:18:34.173 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging 2022-03-11T02:18:34.175 INFO:teuthology.lock.ops:Updating [ubuntu@smithi107.front.sepia.ceph.com]: reset os type and version on server 2022-03-11T02:18:34.175 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-03-11T02:18:34.194 INFO:teuthology.lock.ops:Node 'ubuntu@smithi107.front.sepia.ceph.com' reimaging is complete 2022-03-11T02:18:34.194 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging 2022-03-11T02:18:34.195 INFO:teuthology.lock.ops:Updating [ubuntu@smithi156.front.sepia.ceph.com]: reset os type and version on server 2022-03-11T02:18:34.195 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-03-11T02:18:34.214 INFO:teuthology.lock.ops:Node 'ubuntu@smithi156.front.sepia.ceph.com' reimaging is complete 2022-03-11T02:18:34.405 INFO:teuthology.provision.fog.smithi107:Scheduling deploy of centos 8.stream 2022-03-11T02:18:34.419 INFO:teuthology.provision.fog.smithi156:Scheduling deploy of centos 8.stream 2022-03-11T02:18:34.772 INFO:teuthology.orchestra.console:Power off smithi156 2022-03-11T02:18:34.787 INFO:teuthology.orchestra.console:Power off smithi107 2022-03-11T02:18:47.253 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-03-11T02:18:47.259 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-03-11T02:18:47.355 INFO:teuthology.orchestra.console:Power on smithi156 2022-03-11T02:18:47.364 INFO:teuthology.orchestra.console:Power on smithi107 2022-03-11T02:18:51.614 INFO:teuthology.orchestra.console:Power on for smithi156 completed 2022-03-11T02:18:51.716 INFO:teuthology.provision.fog.smithi156:Waiting for deploy to finish 2022-03-11T02:18:55.732 INFO:teuthology.orchestra.console:Power on for smithi107 completed 2022-03-11T02:18:55.833 INFO:teuthology.provision.fog.smithi107:Waiting for deploy to finish 2022-03-11T02:23:04.905 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-11T02:23:30.321 INFO:teuthology.provision.fog.smithi107:Node is ready 2022-03-11T02:23:30.344 INFO:teuthology.orchestra.run.smithi107.stdout:smithi107.front.sepia.ceph.com 2022-03-11T02:23:30.403 INFO:teuthology.orchestra.run.smithi107.stdout:172.21.15.107 smithi107.front.sepia.ceph.com smithi107 2022-03-11T02:23:30.784 INFO:teuthology.provision.fog.smithi107:Deploy complete! 2022-03-11T02:23:47.886 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-03-11T02:23:48.129 INFO:teuthology.provision.fog.smithi156:Node is ready 2022-03-11T02:23:48.188 INFO:teuthology.orchestra.run.smithi156.stdout:smithi156.front.sepia.ceph.com 2022-03-11T02:23:48.246 INFO:teuthology.orchestra.run.smithi156.stdout:172.21.15.156 smithi156.front.sepia.ceph.com smithi156 2022-03-11T02:23:48.600 INFO:teuthology.provision.fog.smithi156:Deploy complete! 2022-03-11T02:23:48.766 INFO:teuthology.lock.ops:Checking smithi107.front.sepia.ceph.com 2022-03-11T02:23:48.768 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-11T02:23:48.790 INFO:teuthology.lock.ops:Checking smithi156.front.sepia.ceph.com 2022-03-11T02:23:48.790 INFO:teuthology.lock.ops:New key found. Updating... 2022-03-11T02:23:48.846 INFO:teuthology.lock.ops:Updating [smithi107.front.sepia.ceph.com]: set os type and version on server 2022-03-11T02:23:48.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-03-11T02:23:49.044 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2022-03-11T02:23:49.103 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2022-03-11T02:23:49.104 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="8" 2022-03-11T02:23:49.104 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2022-03-11T02:23:49.104 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2022-03-11T02:23:49.105 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="8" 2022-03-11T02:23:49.105 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el8" 2022-03-11T02:23:49.105 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-11T02:23:49.106 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2022-03-11T02:23:49.106 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-11T02:23:49.106 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2022-03-11T02:23:49.107 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-11T02:23:49.107 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-11T02:23:49.107 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-11T02:23:49.109 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2022-03-11T02:23:49.127 INFO:teuthology.lock.ops:Updating [smithi156.front.sepia.ceph.com]: set os type and version on server 2022-03-11T02:23:49.127 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-03-11T02:23:49.321 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2022-03-11T02:23:49.377 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="CentOS Stream" 2022-03-11T02:23:49.378 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8" 2022-03-11T02:23:49.378 INFO:teuthology.orchestra.run.smithi156.stdout:ID="centos" 2022-03-11T02:23:49.378 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="rhel fedora" 2022-03-11T02:23:49.379 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8" 2022-03-11T02:23:49.379 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2022-03-11T02:23:49.379 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-11T02:23:49.379 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2022-03-11T02:23:49.380 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-11T02:23:49.380 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://centos.org/" 2022-03-11T02:23:49.380 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-11T02:23:49.380 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-11T02:23:49.381 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-11T02:23:49.381 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2022-03-11T02:23:49.484 INFO:teuthology.dispatcher.supervisor:Running job 6730821 2022-03-11T02:23:49.484 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_ff5db9169566776b2f41faf671316ca58a318ea6/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-03-11_00:13:58-rados-wip-yuri11-testing-2022-03-10-1443-octopus-distro-default-smithi/6730821 --name yuriw-2022-03-11_00:13:58-rados-wip-yuri11-testing-2022-03-10-1443-octopus-distro-default-smithi --description rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} -- /home/teuthworker/archive/yuriw-2022-03-11_00:13:58-rados-wip-yuri11-testing-2022-03-10-1443-octopus-distro-default-smithi/6730821/orig.config.yaml 2022-03-11T02:23:49.488 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-03-11_00:13:58-rados-wip-yuri11-testing-2022-03-10-1443-octopus-distro-default-smithi/6730821 2022-03-11T02:23:49.489 INFO:teuthology.dispatcher.supervisor:Job PID: 30299 2022-03-11T02:23:49.489 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-03-11T08:54:17.849 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-03-11T08:54:18.041 INFO:teuthology.kill:Killing Pids: {30299} 2022-03-11T08:54:19.297 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-03-11T08:54:19.298 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-03-11T08:54:19.298 INFO:teuthology.misc:Compressing logs... 2022-03-11T08:54:19.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2022-03-11T08:54:19.560 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2022-03-11T08:54:40.027 INFO:teuthology.kill:No teuthology processes running 2022-03-11T08:54:41.248 INFO:teuthology.kill:Nuking machines: ['smithi107', 'smithi156'] 2022-03-11T08:54:42.217 INFO:teuthology.kill:2022-03-11 08:54:42,216.216 INFO:teuthology.nuke:targets: 2022-03-11T08:54:42.218 INFO:teuthology.kill: smithi107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC613YAOZdv7Hp8w88MqIgyhF4YHdHw4SjLaYi0wSHFwSBCA0pvxi+bc6gGQYcdnqAkkS4QBhvsR0c9UfCOGAVgPdw8A/pL1l+p5nx02K0tb6W7TmfCmvtmCLLqqkQ8zuInegePaldT8HjHbDpsiTZ3XEsZ4JENh6wbBzVS2ZJsF74LYHd9OnAcqXEspRAElPhoMEDYTkAs6wBfGF3K7cGg0LrsYxX4Dt1fXkOv/xqrX4c/SiU9bYD8Evi2EeQfVe6VDToWnvMOn/7mmtydaVVQdnDTFeQi/3XXn2gKlLvew1W4vKKQnmaqC63CUHdeJGPu9sdfjC5EvUvHbFAR+13ufYJshWE54R3ZTuS996EZc4dmQ0WPPkM4hoQZcowuCW0fLsccYajEAdGKFPiuofG0w4wdo4v0sADJNjmNNhzNdljIhC12lcwu+GXNY7sA+f3gvNQXyawmdV/hkMdxwOYXwZb+Z76f0GyoFo3AjOULTMPT0srLWK8myuHtc1j9VLs= 2022-03-11T08:54:42.218 INFO:teuthology.kill: smithi156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFbEpT8+fWuG/jnaMMeQFi8iSrdKWnXPoGjvmwy0H0w1WqbVtEL1enjY8kt81Jq0HlmOI/zeC5vW4OkpiktOIn5MYnQo9mxWzfXp6KntOvIyWoZ/ZMXaUCmf5Wx/RYdP0FJujc9Lvcb5Dbac17U+tT9MwRkOH+jhWE/GAWHNik8gUmtvtmnhszoZNyev5HFQgrFk1n/PfOibDL5uB6lTDK+7VBktzS1GCGSMwZbq8LCSlSUJ2ROLjBHqNHfB4FLpAdfnO3j+fXloSDPBPBRBhoUrvHksMj9+KoelP+PucU0eCV/JBXmz1ykECz1USrXuta1tHdEiT87T/fk52Ofvo1SedUjTRS3J3pmGLOsWJlSq+tXbtlKASbK4nhiVLZlmrdU7tjp7hg0R8QFS2p1OIxCPejIw36Q2vFc2NnD2xKwoeEnM3JnUhDIaL2gskNCfb/oaDrprqRKp+Xa8o2G1P32eAfG6pF3Hqt/vPich2E8VWaMzvIcSDuvrnBqdN0Gvk= 2022-03-11T08:54:42.245 INFO:teuthology.kill:2022-03-11 08:54:42,244.244 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-11T08:54:42.248 INFO:teuthology.kill:2022-03-11 08:54:42,248.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-11T08:54:42.324 INFO:teuthology.kill:2022-03-11 08:54:42,324.324 INFO:teuthology.orchestra.console:Power off smithi156 2022-03-11T08:54:42.338 INFO:teuthology.kill:2022-03-11 08:54:42,337.337 INFO:teuthology.orchestra.console:Power off smithi107 2022-03-11T08:54:50.694 INFO:teuthology.kill:2022-03-11 08:54:50,693.693 INFO:teuthology.orchestra.console:Power off for smithi156 completed 2022-03-11T08:54:50.700 INFO:teuthology.kill:2022-03-11 08:54:50,700.700 INFO:teuthology.orchestra.console:Power off for smithi107 completed 2022-03-11T08:54:50.844 INFO:teuthology.kill:2022-03-11 08:54:50,843.843 INFO:teuthology.lock.ops:unlocked: smithi156.front.sepia.ceph.com 2022-03-11T08:54:50.847 INFO:teuthology.kill:2022-03-11 08:54:50,847.847 INFO:teuthology.lock.ops:unlocked: smithi107.front.sepia.ceph.com 2022-03-11T08:56:51.163 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-03-11T08:56:51.290 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi107 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-11_03:20:03-krbd-master-testing-default-smithi/6731054 2022-03-11T08:56:51.290 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi156 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-03-11_03:20:03-krbd-master-testing-default-smithi/6731054