2022-07-28T08:24:07.740 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-28T08:24:07.875 INFO:teuthology.lock.ops:Start node 'smithi001.front.sepia.ceph.com' reimaging 2022-07-28T08:24:07.877 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T08:24:07.877 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2022-07-28T08:24:07.898 INFO:teuthology.lock.ops:Node 'smithi001.front.sepia.ceph.com' reimaging is complete 2022-07-28T08:24:07.898 INFO:teuthology.lock.ops:Start node 'smithi129.front.sepia.ceph.com' reimaging 2022-07-28T08:24:07.899 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: reset os type and version on server 2022-07-28T08:24:07.900 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2022-07-28T08:24:07.923 INFO:teuthology.lock.ops:Node 'smithi129.front.sepia.ceph.com' reimaging is complete 2022-07-28T08:24:08.112 INFO:teuthology.provision.fog.smithi001:Scheduling deploy of centos 8.stream 2022-07-28T08:24:08.129 INFO:teuthology.provision.fog.smithi129:Scheduling deploy of centos 8.stream 2022-07-28T08:24:08.444 INFO:teuthology.orchestra.console:Power off smithi001 2022-07-28T08:24:08.458 INFO:teuthology.orchestra.console:Power off smithi129 2022-07-28T08:24:08.585 INFO:teuthology.orchestra.console:Power off for smithi001 completed 2022-07-28T08:24:08.597 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2022-07-28T08:24:08.687 INFO:teuthology.orchestra.console:Power on smithi001 2022-07-28T08:24:08.698 INFO:teuthology.orchestra.console:Power on smithi129 2022-07-28T08:24:12.948 INFO:teuthology.orchestra.console:Power on for smithi129 completed 2022-07-28T08:24:13.049 INFO:teuthology.provision.fog.smithi129:Waiting for deploy to finish 2022-07-28T08:24:17.059 INFO:teuthology.orchestra.console:Power on for smithi001 completed 2022-07-28T08:24:17.161 INFO:teuthology.provision.fog.smithi001:Waiting for deploy to finish 2022-07-28T08:26:44.184 ERROR:teuthology.orchestra.connection:Error authenticating with smithi129.front.sepia.ceph.com: Authentication failed. 2022-07-28T08:28:24.750 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:28:24.960 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-28T08:28:25.016 INFO:teuthology.provision.fog.smithi001:Node is ready 2022-07-28T08:28:25.037 INFO:teuthology.orchestra.run.smithi001.stdout:smithi001.front.sepia.ceph.com 2022-07-28T08:28:25.097 INFO:teuthology.orchestra.run.smithi001.stdout:172.21.15.1 smithi001.front.sepia.ceph.com smithi001 2022-07-28T08:28:25.457 INFO:teuthology.provision.fog.smithi001:Deploy complete! 2022-07-28T08:28:49.968 INFO:teuthology.provision.fog.smithi129:Node is ready 2022-07-28T08:28:49.990 INFO:teuthology.orchestra.run.smithi129.stdout:smithi129.front.sepia.ceph.com 2022-07-28T08:28:50.048 INFO:teuthology.orchestra.run.smithi129.stdout:172.21.15.129 smithi129.front.sepia.ceph.com smithi129 2022-07-28T08:28:50.413 INFO:teuthology.provision.fog.smithi129:Deploy complete! 2022-07-28T08:28:50.585 INFO:teuthology.lock.ops:Checking smithi001.front.sepia.ceph.com 2022-07-28T08:28:50.587 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:28:50.614 INFO:teuthology.lock.ops:Checking smithi129.front.sepia.ceph.com 2022-07-28T08:28:50.614 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-28T08:28:50.634 INFO:teuthology.lock.ops:Updating [smithi001.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:28:50.635 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2022-07-28T08:28:50.857 INFO:teuthology.orchestra.run.smithi001.stdout:x86_64 2022-07-28T08:28:50.918 INFO:teuthology.orchestra.run.smithi001.stdout:NAME="CentOS Stream" 2022-07-28T08:28:50.918 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION="8" 2022-07-28T08:28:50.918 INFO:teuthology.orchestra.run.smithi001.stdout:ID="centos" 2022-07-28T08:28:50.919 INFO:teuthology.orchestra.run.smithi001.stdout:ID_LIKE="rhel fedora" 2022-07-28T08:28:50.919 INFO:teuthology.orchestra.run.smithi001.stdout:VERSION_ID="8" 2022-07-28T08:28:50.919 INFO:teuthology.orchestra.run.smithi001.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:28:50.919 INFO:teuthology.orchestra.run.smithi001.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-28T08:28:50.920 INFO:teuthology.orchestra.run.smithi001.stdout:ANSI_COLOR="0;31" 2022-07-28T08:28:50.920 INFO:teuthology.orchestra.run.smithi001.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-28T08:28:50.920 INFO:teuthology.orchestra.run.smithi001.stdout:HOME_URL="https://centos.org/" 2022-07-28T08:28:50.920 INFO:teuthology.orchestra.run.smithi001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:28:50.920 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:28:50.921 INFO:teuthology.orchestra.run.smithi001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-28T08:28:50.922 INFO:teuthology.lock.ops:Updating smithi001.front.sepia.ceph.com on lock server 2022-07-28T08:28:50.945 INFO:teuthology.lock.ops:Updating [smithi129.front.sepia.ceph.com]: set os type and version on server 2022-07-28T08:28:50.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2022-07-28T08:28:51.141 INFO:teuthology.orchestra.run.smithi129.stdout:x86_64 2022-07-28T08:28:51.199 INFO:teuthology.orchestra.run.smithi129.stdout:NAME="CentOS Stream" 2022-07-28T08:28:51.199 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION="8" 2022-07-28T08:28:51.199 INFO:teuthology.orchestra.run.smithi129.stdout:ID="centos" 2022-07-28T08:28:51.200 INFO:teuthology.orchestra.run.smithi129.stdout:ID_LIKE="rhel fedora" 2022-07-28T08:28:51.200 INFO:teuthology.orchestra.run.smithi129.stdout:VERSION_ID="8" 2022-07-28T08:28:51.200 INFO:teuthology.orchestra.run.smithi129.stdout:PLATFORM_ID="platform:el8" 2022-07-28T08:28:51.200 INFO:teuthology.orchestra.run.smithi129.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-28T08:28:51.201 INFO:teuthology.orchestra.run.smithi129.stdout:ANSI_COLOR="0;31" 2022-07-28T08:28:51.201 INFO:teuthology.orchestra.run.smithi129.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-28T08:28:51.201 INFO:teuthology.orchestra.run.smithi129.stdout:HOME_URL="https://centos.org/" 2022-07-28T08:28:51.201 INFO:teuthology.orchestra.run.smithi129.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-28T08:28:51.201 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-28T08:28:51.202 INFO:teuthology.orchestra.run.smithi129.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-28T08:28:51.202 INFO:teuthology.lock.ops:Updating smithi129.front.sepia.ceph.com on lock server 2022-07-28T08:28:51.313 INFO:teuthology.dispatcher.supervisor:Running job 6951681 2022-07-28T08:28:51.313 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/bin/teuthology -v --owner scheduled_gabrioux@teuthology --archive /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951681 --name gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi --description orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} -- /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951681/orig.config.yaml 2022-07-28T08:28:51.318 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951681 2022-07-28T08:28:51.319 INFO:teuthology.dispatcher.supervisor:Job PID: 26089 2022-07-28T08:28:51.319 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-28T20:29:16.433 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-28T20:29:16.625 INFO:teuthology.kill:Killing Pids: {26089} 2022-07-28T20:29:18.332 INFO:teuthology.task.internal:roles: ubuntu@smithi001.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-28T20:29:18.334 INFO:teuthology.task.internal:roles: ubuntu@smithi129.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-28T20:29:18.335 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:18.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi001.front.sepia.ceph.com' 2022-07-28T20:29:18.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi129.front.sepia.ceph.com' 2022-07-28T20:29:18.986 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:19.166 INFO:teuthology.misc:Compressing logs... 2022-07-28T20:29:21.487 INFO:teuthology.orchestra.run.smithi129.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping 2022-07-28T20:29:21.666 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-28T20:29:23.755 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-28T20:29:25.525 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-28T20:29:30.791 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-28T20:29:32.576 INFO:teuthology.orchestra.run.smithi001.stderr:gzip: /var/log/ceph/b592d3aa-0e50-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-28T20:29:35.760 INFO:teuthology.kill:No teuthology processes running 2022-07-28T20:29:37.758 INFO:teuthology.kill:Nuking machines: ['smithi001', 'smithi129'] 2022-07-28T20:29:39.299 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_5f965ce157b8dcdaf2da92a5b5d1a63e787efdd9/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-28T20:29:39.300 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-28T20:29:39.300 INFO:teuthology.kill:2022-07-28 20:29:39,298.298 INFO:teuthology.nuke:targets: 2022-07-28T20:29:39.309 INFO:teuthology.kill: smithi001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEXM8qSfeh43bf8AAZK1oHdaknTdrMVMUFyqRHbKDXYjMazv4q1l/ymfCn0ZBkFHPRbENhruWffsVW+Jz9mDgUBXnDe5Eei4YVQ7aHNiAqJu788+Spw056Y/ns1FJw+LUauSyfZKZLJz5+FILuDCkc4JuO4fLge7/Sk92t9VXTlZabeS95axNEZgoY+peVlmHk7UkIt+ZdhTw4YWPUqq1P0KDDHfroQo5CJvbJXUjneMwXp3xAAMvu8nrFXfFgWz81WfAEIXEgy932IwM+Yuyy8/fsRVttXZtV4r4I7lcnEPydlW6xER9nnvKSpWGf+knFWVp9ISU+Z79Hf2EHAuv4Aki6md/rC76oo3ONwjvo1IczU2k5ITaILZgBkVNLadU1UUAFZOV5hkPSLUeT5o8l0BcX6ozD3Uz5fguZAiYdXXOUO8klwmucCYubBBat7ZdQfGpohQiI9eC1LfGyCq+hpms+KpHa008ePDmcEsvUilTfcGD+DDNZC5n0clIqrhc= 2022-07-28T20:29:39.310 INFO:teuthology.kill: smithi129.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvlNNg37/s8NvrYEYl7UPbrAE8nYfrIBCN/0trkQB2UPxP2ZvjFrktEQcfPpyaEHTAcwgwgCwL3ssKaKM+MSNtgowcSd5diysw234QiJWnwXD1TZOCtBNjnngvXec2hWvvQp/zb4J1uZFfLYipdKBieEQiZUzWAjrJEXzwSZppI8FCMOTMUAS7BZEXy0EA1TgkHikgOyVM6XhKSZ1Lg+TVdROdwD4OS9vr4we/hl/vzf3vbwycXv4D2HNpf9DhQWsJIy4vTZYaShLzRKITPMjE7cmGbUJcXOTiTZYOavlpOtOp0XZXuAVk+mkCqkL7W2/V3bTOknHpQ3OdrZyNa5URSiiM4xncTu8xj1DtMxbyvy+dwUXQHTzUKLf7vowQM/xOJCC9Msd7rSR750zJEHzJZiSgFk6adsnXdi5dyA38JtGFLwmoJ9EmZOguPylaBzw3nwAF4lR4KkIjzz3NvYiVYLmeMQJHjOXWsNcx9zFGo2Lj6xJ+TL0h/SjJO5TT38M= 2022-07-28T20:29:39.310 INFO:teuthology.kill:2022-07-28 20:29:39,298.298 INFO:teuthology.nuke:Checking targets against current locks 2022-07-28T20:29:39.358 INFO:teuthology.kill:2022-07-28 20:29:39,358.358 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:29:39.393 INFO:teuthology.kill:2022-07-28 20:29:39,392.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-28T20:29:39.463 INFO:teuthology.kill:2022-07-28 20:29:39,462.462 INFO:teuthology.orchestra.console:Power off smithi001 2022-07-28T20:29:39.550 INFO:teuthology.kill:2022-07-28 20:29:39,549.549 INFO:teuthology.orchestra.console:Power off smithi129 2022-07-28T20:29:47.894 INFO:teuthology.kill:2022-07-28 20:29:47,894.894 INFO:teuthology.orchestra.console:Power off for smithi001 completed 2022-07-28T20:29:47.934 INFO:teuthology.kill:2022-07-28 20:29:47,934.934 INFO:teuthology.orchestra.console:Power off for smithi129 completed 2022-07-28T20:29:48.052 INFO:teuthology.kill:2022-07-28 20:29:48,051.051 INFO:teuthology.lock.ops:unlocked: smithi001.front.sepia.ceph.com 2022-07-28T20:29:48.087 INFO:teuthology.kill:2022-07-28 20:29:48,087.087 INFO:teuthology.lock.ops:unlocked: smithi129.front.sepia.ceph.com 2022-07-28T20:31:48.383 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-28T20:31:48.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi001 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:17:14-fs-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952569 2022-07-28T20:31:48.491 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi129 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-28_15:17:14-fs-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6952569