2022-07-26T17:08:52.778 INFO:root:teuthology version: 1.1.1.dev392+gefc3ff73
2022-07-26T17:08:52.940 INFO:teuthology.lock.ops:Start node 'smithi165.front.sepia.ceph.com' reimaging
2022-07-26T17:08:52.941 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: reset os type and version on server
2022-07-26T17:08:52.943 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-07-26T17:08:52.966 INFO:teuthology.lock.ops:Node 'smithi165.front.sepia.ceph.com' reimaging is complete
2022-07-26T17:08:52.966 INFO:teuthology.lock.ops:Start node 'smithi204.front.sepia.ceph.com' reimaging
2022-07-26T17:08:52.967 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: reset os type and version on server
2022-07-26T17:08:52.967 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2022-07-26T17:08:52.987 INFO:teuthology.lock.ops:Node 'smithi204.front.sepia.ceph.com' reimaging is complete
2022-07-26T17:08:53.187 INFO:teuthology.provision.fog.smithi165:Scheduling deploy of centos 8.stream
2022-07-26T17:08:53.232 INFO:teuthology.provision.fog.smithi204:Scheduling deploy of centos 8.stream
2022-07-26T17:08:53.611 INFO:teuthology.orchestra.console:Power off smithi165
2022-07-26T17:08:53.662 INFO:teuthology.orchestra.console:Power off smithi204
2022-07-26T17:08:53.773 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-07-26T17:08:53.808 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2022-07-26T17:08:53.875 INFO:teuthology.orchestra.console:Power on smithi165
2022-07-26T17:08:53.910 INFO:teuthology.orchestra.console:Power on smithi204
2022-07-26T17:08:58.135 INFO:teuthology.orchestra.console:Power on for smithi165 completed
2022-07-26T17:08:58.162 INFO:teuthology.orchestra.console:Power on for smithi204 completed
2022-07-26T17:08:58.238 INFO:teuthology.provision.fog.smithi165:Waiting for deploy to finish
2022-07-26T17:08:58.263 INFO:teuthology.provision.fog.smithi204:Waiting for deploy to finish
2022-07-26T17:13:45.842 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-26T17:13:45.848 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-07-26T17:13:46.091 INFO:teuthology.provision.fog.smithi165:Node is ready
2022-07-26T17:13:46.109 INFO:teuthology.provision.fog.smithi204:Node is ready
2022-07-26T17:13:46.112 INFO:teuthology.orchestra.run.smithi165.stdout:smithi165.front.sepia.ceph.com
2022-07-26T17:13:46.133 INFO:teuthology.orchestra.run.smithi204.stdout:smithi204.front.sepia.ceph.com
2022-07-26T17:13:46.178 INFO:teuthology.orchestra.run.smithi165.stdout:172.21.15.165 smithi165.front.sepia.ceph.com smithi165
2022-07-26T17:13:46.199 INFO:teuthology.orchestra.run.smithi204.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2022-07-26T17:13:46.592 INFO:teuthology.provision.fog.smithi165:Deploy complete!
2022-07-26T17:13:46.617 INFO:teuthology.provision.fog.smithi204:Deploy complete!
2022-07-26T17:13:46.887 INFO:teuthology.lock.ops:Checking smithi165.front.sepia.ceph.com
2022-07-26T17:13:46.888 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-26T17:13:46.928 INFO:teuthology.lock.ops:Checking smithi204.front.sepia.ceph.com
2022-07-26T17:13:46.929 INFO:teuthology.lock.ops:New key found. Updating...
2022-07-26T17:13:46.970 INFO:teuthology.lock.ops:Updating [smithi165.front.sepia.ceph.com]: set os type and version on server
2022-07-26T17:13:46.971 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-07-26T17:13:47.258 INFO:teuthology.orchestra.run.smithi165.stdout:x86_64
2022-07-26T17:13:47.334 INFO:teuthology.orchestra.run.smithi165.stdout:NAME="CentOS Stream"
2022-07-26T17:13:47.335 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION="8"
2022-07-26T17:13:47.336 INFO:teuthology.orchestra.run.smithi165.stdout:ID="centos"
2022-07-26T17:13:47.336 INFO:teuthology.orchestra.run.smithi165.stdout:ID_LIKE="rhel fedora"
2022-07-26T17:13:47.337 INFO:teuthology.orchestra.run.smithi165.stdout:VERSION_ID="8"
2022-07-26T17:13:47.337 INFO:teuthology.orchestra.run.smithi165.stdout:PLATFORM_ID="platform:el8"
2022-07-26T17:13:47.337 INFO:teuthology.orchestra.run.smithi165.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-26T17:13:47.338 INFO:teuthology.orchestra.run.smithi165.stdout:ANSI_COLOR="0;31"
2022-07-26T17:13:47.338 INFO:teuthology.orchestra.run.smithi165.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-26T17:13:47.339 INFO:teuthology.orchestra.run.smithi165.stdout:HOME_URL="https://centos.org/"
2022-07-26T17:13:47.340 INFO:teuthology.orchestra.run.smithi165.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-26T17:13:47.340 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-26T17:13:47.342 INFO:teuthology.orchestra.run.smithi165.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-26T17:13:47.345 INFO:teuthology.lock.ops:Updating smithi165.front.sepia.ceph.com on lock server
2022-07-26T17:13:47.373 INFO:teuthology.lock.ops:Updating [smithi204.front.sepia.ceph.com]: set os type and version on server
2022-07-26T17:13:47.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2022-07-26T17:13:47.740 INFO:teuthology.orchestra.run.smithi204.stdout:x86_64
2022-07-26T17:13:47.800 INFO:teuthology.orchestra.run.smithi204.stdout:NAME="CentOS Stream"
2022-07-26T17:13:47.800 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION="8"
2022-07-26T17:13:47.801 INFO:teuthology.orchestra.run.smithi204.stdout:ID="centos"
2022-07-26T17:13:47.801 INFO:teuthology.orchestra.run.smithi204.stdout:ID_LIKE="rhel fedora"
2022-07-26T17:13:47.802 INFO:teuthology.orchestra.run.smithi204.stdout:VERSION_ID="8"
2022-07-26T17:13:47.802 INFO:teuthology.orchestra.run.smithi204.stdout:PLATFORM_ID="platform:el8"
2022-07-26T17:13:47.803 INFO:teuthology.orchestra.run.smithi204.stdout:PRETTY_NAME="CentOS Stream 8"
2022-07-26T17:13:47.803 INFO:teuthology.orchestra.run.smithi204.stdout:ANSI_COLOR="0;31"
2022-07-26T17:13:47.804 INFO:teuthology.orchestra.run.smithi204.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2022-07-26T17:13:47.804 INFO:teuthology.orchestra.run.smithi204.stdout:HOME_URL="https://centos.org/"
2022-07-26T17:13:47.804 INFO:teuthology.orchestra.run.smithi204.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-07-26T17:13:47.805 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2022-07-26T17:13:47.805 INFO:teuthology.orchestra.run.smithi204.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2022-07-26T17:13:47.807 INFO:teuthology.lock.ops:Updating smithi204.front.sepia.ceph.com on lock server
2022-07-26T17:13:47.952 INFO:teuthology.dispatcher.supervisor:Running job 6948049
2022-07-26T17:13:47.953 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_efc3ff73817de4d5653d1e4a5fa0c6a0d5434cf7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948049 --name yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi --description rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} -- /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948049/orig.config.yaml
2022-07-26T17:13:47.960 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948049
2022-07-26T17:13:47.962 INFO:teuthology.dispatcher.supervisor:Job PID: 16207
2022-07-26T17:13:47.963 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-07-27T05:14:45.800 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-07-27T05:14:45.954 INFO:teuthology.kill:Killing Pids: {16207}
2022-07-27T05:14:47.474 INFO:teuthology.task.internal:roles: ubuntu@smithi165.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a']
2022-07-27T05:14:47.475 INFO:teuthology.task.internal:roles: ubuntu@smithi204.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a']
2022-07-27T05:14:47.476 INFO:teuthology.misc:Compressing logs...
2022-07-27T05:14:47.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi165.front.sepia.ceph.com'
2022-07-27T05:14:47.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi204.front.sepia.ceph.com'
2022-07-27T05:14:47.706 INFO:teuthology.orchestra.run.smithi165.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-07-27T05:14:47.815 INFO:teuthology.orchestra.run.smithi204.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory
2022-07-27T05:14:47.861 INFO:teuthology.orchestra.run.smithi165.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-07-27T05:14:47.861 INFO:teuthology.orchestra.run.smithi165.stderr:tar: Error is not recoverable: exiting now
2022-07-27T05:14:47.898 INFO:teuthology.orchestra.run.smithi204.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory
2022-07-27T05:14:47.899 INFO:teuthology.orchestra.run.smithi204.stderr:tar: Error is not recoverable: exiting now
2022-07-27T05:14:47.900 INFO:teuthology.misc:Compressing logs...
2022-07-27T05:14:48.139 INFO:teuthology.misc:Compressing logs...
2022-07-27T05:14:48.920 INFO:teuthology.orchestra.run.smithi204.stderr:gzip: /var/log/ceph/6f654f74-0d07-11ed-8430-001a4aab830c/ceph-mon.b.log: file size changed while zipping
2022-07-27T05:14:49.000 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6f654f74-0d07-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping
2022-07-27T05:14:49.349 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6f654f74-0d07-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping
2022-07-27T05:14:50.462 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6f654f74-0d07-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping
2022-07-27T05:14:50.749 INFO:teuthology.orchestra.run.smithi165.stderr:gzip: /var/log/ceph/6f654f74-0d07-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping
2022-07-27T05:14:54.242 INFO:teuthology.kill:No teuthology processes running
2022-07-27T05:14:55.644 INFO:teuthology.kill:Nuking machines: ['smithi165', 'smithi204']
2022-07-27T05:14:56.789 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_efc3ff73817de4d5653d1e4a5fa0c6a0d5434cf7/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-07-27T05:14:56.790 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-07-27T05:14:56.790 INFO:teuthology.kill:2022-07-27 05:14:56,789.789 INFO:teuthology.nuke:targets:
2022-07-27T05:14:56.791 INFO:teuthology.kill:  smithi165.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwtCpsKZTaCeDeEQKWo3Zyfxr29axMQtvybx+htw9BNp+KsOGjSOsj4vLLyxVW7uGtJoqVTEuYRNO291myPn+w4hYB2Yc7GUSX8MPBhXXgDN/AfGhdTGVGq0cpHzNwHzDhjKM2Iumzzdt8u/udau8dIY4Vd3SXuMHTs0OwI8BhC5YmKlAIZskRSgE2OVK4E5cEQg/nXQD1/VlTHrfqSvW1uEq3o/RF9Ay3Ky7vQ6snJYial8E2ttjynMmNpSLMV9+6t1frY5SOptXkeHzMfDlOAO2OCGUi9WYszEgHcS5eeAn5ZjNXpCmslAHzq7rt30CmaGmwZvFd9mQc0x7o7zj+zZQLu6RrTtSo8kS9jIb+3ZLK1GEqh3r/uC3Z70flCrZ751wCMU0dXgqEldK14tmfEdR6akkrk7WrnNWuaqOv4aAPTrnq8fxvZOXn3xsVF764q8lRIq8BrdgpiKRg7raGzq1yORkMVeK99wwXq6HWQRfIQh8nwq2mfkMQO7UQnrk=
2022-07-27T05:14:56.791 INFO:teuthology.kill:  smithi204.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGXmcHVsmUW8WBAXTc+w/IxbRNIsaI5uj6pLOm39Z/V0xpa/C8Fg5pxehGuvjTYZR4jNYTDK7qDNQ3pX5/3JUbS28piW+VdOS2frTq0PcGNCm26v+4ZKzySAhqFA/tCmtu2Nk1aaZl8wX9LeemZT/AAMTy0sRLMPk53hU36oNiN/iilWEtolHzBPBRgnQb6vZB7uVvWZ6A71oOR7cTLKr0/xgp4WiFaxtCJCx9z8Pe9UpGyweX69qsx7aIx1wXAp/01a2bcDY+USyXQKKhZsz6I/acDJqkEVFolfiYqDQbBh7W4zw0itHfWndW2aoCF48Tcd8fbCvmMjVdNwsgZAnWeMo6q7rsyp+mOSg+31DyBPc70NsalnYMdDtLgJ2SfYk+YLc3Dc16vCnOUwyrM1OJM9J5n8bIh3TNJE8QNlBJT4TKH9yl3qhrKl68DJqLYKffMjdiMu83oSnU7rpi8XDzMmi8V0W9tbJn4rUKjBzVBr9nZ89Hyz3bAqrSATVDy6E=
2022-07-27T05:14:56.791 INFO:teuthology.kill:2022-07-27 05:14:56,789.789 INFO:teuthology.nuke:Checking targets against current locks
2022-07-27T05:14:56.851 INFO:teuthology.kill:2022-07-27 05:14:56,851.851 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-27T05:14:56.869 INFO:teuthology.kill:2022-07-27 05:14:56,869.869 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-07-27T05:14:56.929 INFO:teuthology.kill:2022-07-27 05:14:56,928.928 INFO:teuthology.orchestra.console:Power off smithi165
2022-07-27T05:14:56.966 INFO:teuthology.kill:2022-07-27 05:14:56,965.965 INFO:teuthology.orchestra.console:Power off smithi204
2022-07-27T05:15:05.301 INFO:teuthology.kill:2022-07-27 05:15:05,299.299 INFO:teuthology.orchestra.console:Power off for smithi165 completed
2022-07-27T05:15:05.328 INFO:teuthology.kill:2022-07-27 05:15:05,328.328 INFO:teuthology.orchestra.console:Power off for smithi204 completed
2022-07-27T05:15:05.456 INFO:teuthology.kill:2022-07-27 05:15:05,455.455 INFO:teuthology.lock.ops:unlocked: smithi165.front.sepia.ceph.com
2022-07-27T05:15:05.477 INFO:teuthology.kill:2022-07-27 05:15:05,477.477 INFO:teuthology.lock.ops:unlocked: smithi204.front.sepia.ceph.com
2022-07-27T05:17:05.810 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-07-27T05:17:05.903 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi165 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_01:48:00-fs-wip-yuri6-testing-2022-07-26-1538-octopus-distro-default-smithi/6948792
2022-07-27T05:17:05.903 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi204 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_01:48:00-fs-wip-yuri6-testing-2022-07-26-1538-octopus-distro-default-smithi/6948792