2022-07-26T16:55:08.680 INFO:root:teuthology version: 1.1.1.dev392+gefc3ff73 2022-07-26T16:55:08.872 INFO:teuthology.lock.ops:Start node 'smithi005.front.sepia.ceph.com' reimaging 2022-07-26T16:55:08.873 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: reset os type and version on server 2022-07-26T16:55:08.874 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-07-26T16:55:08.910 INFO:teuthology.lock.ops:Node 'smithi005.front.sepia.ceph.com' reimaging is complete 2022-07-26T16:55:08.910 INFO:teuthology.lock.ops:Start node 'smithi074.front.sepia.ceph.com' reimaging 2022-07-26T16:55:08.912 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: reset os type and version on server 2022-07-26T16:55:08.913 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-07-26T16:55:08.933 INFO:teuthology.lock.ops:Node 'smithi074.front.sepia.ceph.com' reimaging is complete 2022-07-26T16:55:09.172 INFO:teuthology.provision.fog.smithi005:Scheduling deploy of centos 8.stream 2022-07-26T16:55:09.178 INFO:teuthology.provision.fog.smithi074:Scheduling deploy of centos 8.stream 2022-07-26T16:55:09.573 INFO:teuthology.orchestra.console:Power off smithi074 2022-07-26T16:55:09.639 INFO:teuthology.orchestra.console:Power off smithi005 2022-07-26T16:55:09.753 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-07-26T16:55:09.808 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-07-26T16:55:09.855 INFO:teuthology.orchestra.console:Power on smithi074 2022-07-26T16:55:09.917 INFO:teuthology.orchestra.console:Power on smithi005 2022-07-26T16:55:14.194 INFO:teuthology.orchestra.console:Power on for smithi005 completed 2022-07-26T16:55:14.296 INFO:teuthology.provision.fog.smithi005:Waiting for deploy to finish 2022-07-26T16:55:18.408 INFO:teuthology.orchestra.console:Power on for smithi074 completed 2022-07-26T16:55:18.509 INFO:teuthology.provision.fog.smithi074:Waiting for deploy to finish 2022-07-26T16:59:24.928 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-26T16:59:28.246 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-07-26T16:59:28.545 INFO:teuthology.provision.fog.smithi005:Node is ready 2022-07-26T16:59:28.565 INFO:teuthology.orchestra.run.smithi005.stdout:smithi005.front.sepia.ceph.com 2022-07-26T16:59:28.629 INFO:teuthology.orchestra.run.smithi005.stdout:172.21.15.5 smithi005.front.sepia.ceph.com smithi005 2022-07-26T16:59:28.989 INFO:teuthology.provision.fog.smithi005:Deploy complete! 2022-07-26T16:59:50.494 INFO:teuthology.provision.fog.smithi074:Node is ready 2022-07-26T16:59:50.520 INFO:teuthology.orchestra.run.smithi074.stdout:smithi074.front.sepia.ceph.com 2022-07-26T16:59:50.588 INFO:teuthology.orchestra.run.smithi074.stdout:172.21.15.74 smithi074.front.sepia.ceph.com smithi074 2022-07-26T16:59:50.978 INFO:teuthology.provision.fog.smithi074:Deploy complete! 2022-07-26T16:59:51.282 INFO:teuthology.lock.ops:Checking smithi005.front.sepia.ceph.com 2022-07-26T16:59:51.304 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-26T16:59:51.329 INFO:teuthology.lock.ops:Checking smithi074.front.sepia.ceph.com 2022-07-26T16:59:51.330 INFO:teuthology.lock.ops:New key found. Updating... 2022-07-26T16:59:51.379 INFO:teuthology.lock.ops:Updating [smithi005.front.sepia.ceph.com]: set os type and version on server 2022-07-26T16:59:51.380 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-07-26T16:59:51.864 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2022-07-26T16:59:51.934 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2022-07-26T16:59:51.935 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2022-07-26T16:59:51.935 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2022-07-26T16:59:51.935 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2022-07-26T16:59:51.936 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2022-07-26T16:59:51.936 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2022-07-26T16:59:51.937 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-26T16:59:51.937 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2022-07-26T16:59:51.938 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-26T16:59:51.939 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2022-07-26T16:59:51.939 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-26T16:59:51.940 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-26T16:59:51.940 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-26T16:59:51.942 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2022-07-26T16:59:51.980 INFO:teuthology.lock.ops:Updating [smithi074.front.sepia.ceph.com]: set os type and version on server 2022-07-26T16:59:51.980 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-07-26T16:59:52.306 INFO:teuthology.orchestra.run.smithi074.stdout:x86_64 2022-07-26T16:59:52.367 INFO:teuthology.orchestra.run.smithi074.stdout:NAME="CentOS Stream" 2022-07-26T16:59:52.368 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION="8" 2022-07-26T16:59:52.368 INFO:teuthology.orchestra.run.smithi074.stdout:ID="centos" 2022-07-26T16:59:52.369 INFO:teuthology.orchestra.run.smithi074.stdout:ID_LIKE="rhel fedora" 2022-07-26T16:59:52.369 INFO:teuthology.orchestra.run.smithi074.stdout:VERSION_ID="8" 2022-07-26T16:59:52.371 INFO:teuthology.orchestra.run.smithi074.stdout:PLATFORM_ID="platform:el8" 2022-07-26T16:59:52.371 INFO:teuthology.orchestra.run.smithi074.stdout:PRETTY_NAME="CentOS Stream 8" 2022-07-26T16:59:52.372 INFO:teuthology.orchestra.run.smithi074.stdout:ANSI_COLOR="0;31" 2022-07-26T16:59:52.372 INFO:teuthology.orchestra.run.smithi074.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-07-26T16:59:52.372 INFO:teuthology.orchestra.run.smithi074.stdout:HOME_URL="https://centos.org/" 2022-07-26T16:59:52.373 INFO:teuthology.orchestra.run.smithi074.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-07-26T16:59:52.373 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-07-26T16:59:52.374 INFO:teuthology.orchestra.run.smithi074.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-07-26T16:59:52.375 INFO:teuthology.lock.ops:Updating smithi074.front.sepia.ceph.com on lock server 2022-07-26T16:59:52.499 INFO:teuthology.dispatcher.supervisor:Running job 6948024 2022-07-26T16:59:52.500 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_efc3ff73817de4d5653d1e4a5fa0c6a0d5434cf7/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948024 --name yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi --description rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} -- /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948024/orig.config.yaml 2022-07-26T16:59:52.521 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2022-07-26_15:00:48-rados-wip-yuri-testing-2022-07-25-0645-quincy-distro-default-smithi/6948024 2022-07-26T16:59:52.537 INFO:teuthology.dispatcher.supervisor:Job PID: 4713 2022-07-26T16:59:52.538 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-07-27T05:00:50.797 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-07-27T05:00:50.969 INFO:teuthology.kill:Killing Pids: {4713} 2022-07-27T05:00:52.455 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2022-07-27T05:00:52.456 INFO:teuthology.task.internal:roles: ubuntu@smithi074.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2022-07-27T05:00:52.456 INFO:teuthology.misc:Compressing logs... 2022-07-27T05:00:52.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2022-07-27T05:00:52.677 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi074.front.sepia.ceph.com' 2022-07-27T05:00:52.748 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-07-27T05:00:52.871 INFO:teuthology.orchestra.run.smithi074.stderr:find: ‘/var/lib/ceph/crash’: No such file or directory 2022-07-27T05:00:52.918 INFO:teuthology.orchestra.run.smithi005.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T05:00:52.919 INFO:teuthology.orchestra.run.smithi005.stderr:tar: Error is not recoverable: exiting now 2022-07-27T05:00:53.007 INFO:teuthology.orchestra.run.smithi074.stderr:tar: /var/lib/ceph/crash: Cannot open: No such file or directory 2022-07-27T05:00:53.008 INFO:teuthology.orchestra.run.smithi074.stderr:tar: Error is not recoverable: exiting now 2022-07-27T05:00:53.009 INFO:teuthology.misc:Compressing logs... 2022-07-27T05:00:53.152 INFO:teuthology.misc:Compressing logs... 2022-07-27T05:00:53.473 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/75fae4cc-0d05-11ed-8430-001a4aab830c/ceph-mon.c.log: file size changed while zipping 2022-07-27T05:00:53.739 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/75fae4cc-0d05-11ed-8430-001a4aab830c/ceph-osd.1.log: file size changed while zipping 2022-07-27T05:00:53.965 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/75fae4cc-0d05-11ed-8430-001a4aab830c/ceph-osd.2.log: file size changed while zipping 2022-07-27T05:00:54.616 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/75fae4cc-0d05-11ed-8430-001a4aab830c/ceph-mon.a.log: file size changed while zipping 2022-07-27T05:00:54.846 INFO:teuthology.orchestra.run.smithi005.stderr:gzip: /var/log/ceph/75fae4cc-0d05-11ed-8430-001a4aab830c/ceph-osd.0.log: file size changed while zipping 2022-07-27T05:00:57.676 INFO:teuthology.kill:No teuthology processes running 2022-07-27T05:00:59.108 INFO:teuthology.kill:Nuking machines: ['smithi005', 'smithi074'] 2022-07-27T05:01:00.252 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_efc3ff73817de4d5653d1e4a5fa0c6a0d5434cf7/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-07-27T05:01:00.253 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-07-27T05:01:00.254 INFO:teuthology.kill:2022-07-27 05:01:00,252.252 INFO:teuthology.nuke:targets: 2022-07-27T05:01:00.254 INFO:teuthology.kill: smithi005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCaotnmOScF9uJ/ggQc4/PdjDDuMJAac2NJM0kuyG+nFrtAkCBq6AXz33J04Ka93KNbSpx3Y+QMpb0CbH4Ht0O6mnMdOV9JSEt7lFhju/foG78rGnWxn7+44jqx4uCKHXT4o5sB0zm3ULNwCD2aAUXmiKAGWrFiFpvLRHe1tK19YLvdoonHF48LB4HTPbl/QmrePPQOO3iyKZ35cGmcNLMBIlLsMh1nggbahxesWJW9IvqsRb5Xefv0elF2Pei1yZjhNdbRFzl7QvIHkyDMyibttiGeTibfMYjTB5sJElTSuThA+ujfvimEIEjOoLmpbD/YA5vrz8A2t9aPG5yLzNSsY1gWCO+8dO+APUHxObdRE2m2u5+ubPi40r9yNYmmcpyUpUfuonHf8UcRE/8jJ0mXJfM5qkKYcqCViE81h+Y2BimXxfMoqPQwL1TVuetJLneJk3fEOTFhPn705AsdIkOGdxjleNffGKU2IgrA+ebDD5t79+oR3RPfc4/LPjoUsv8= 2022-07-27T05:01:00.254 INFO:teuthology.kill: smithi074.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNGNjmuumPLHsaXI5oMUAbXQj04tygp8ZGtu3wfBluzuCghrSzdGMxTSbt+9T2UQ/2s+9IzQk6MRUSYkywu7A1jZv3FJAGvvEvJdAKQf079S+dmRNUnfKF91bmv88CVixPN6IrvopJ9T74tcIg9rH6bjYi9+Pw2RAwR6WD8jJpRkYbq821ZZPZ+IPKSkwcCySQS5Yk/0Cm7qLJMZbi6KgK+/Q8ObkZooMeVGVJA978doBhs4tvWi/36/fzMx7O9Y1y+cm/gZMlaF2EIAIre19VdSpxEHQtNzvZqTb0sTPmnpyORkj6Pzkiq3ySXjSjmQJAGdCfXc0xTN/iMCe+jaBXMxzqwjcEtxilFNdq0XVIKsQEHV1noLQDKTa9TgDbybxnUBmmWXGciyjhbDyEP1xjfv+sfoBtJ1xJnJS3xBgldblKURGzfaGZ0RAmDMlalqH+nYGq/0T2xQsSa2ndoMIiWOQS/2AA4Y5GyWy7m71no6ubz6OsNdQeNzZbDXC9LfU= 2022-07-27T05:01:00.255 INFO:teuthology.kill:2022-07-27 05:01:00,253.253 INFO:teuthology.nuke:Checking targets against current locks 2022-07-27T05:01:00.318 INFO:teuthology.kill:2022-07-27 05:01:00,318.318 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T05:01:00.351 INFO:teuthology.kill:2022-07-27 05:01:00,350.350 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-27T05:01:00.411 INFO:teuthology.kill:2022-07-27 05:01:00,410.410 INFO:teuthology.orchestra.console:Power off smithi005 2022-07-27T05:01:00.462 INFO:teuthology.kill:2022-07-27 05:01:00,462.462 INFO:teuthology.orchestra.console:Power off smithi074 2022-07-27T05:01:08.802 INFO:teuthology.kill:2022-07-27 05:01:08,802.802 INFO:teuthology.orchestra.console:Power off for smithi005 completed 2022-07-27T05:01:08.825 INFO:teuthology.kill:2022-07-27 05:01:08,824.824 INFO:teuthology.orchestra.console:Power off for smithi074 completed 2022-07-27T05:01:08.962 INFO:teuthology.kill:2022-07-27 05:01:08,961.961 INFO:teuthology.lock.ops:unlocked: smithi005.front.sepia.ceph.com 2022-07-27T05:01:08.983 INFO:teuthology.kill:2022-07-27 05:01:08,982.982 INFO:teuthology.lock.ops:unlocked: smithi074.front.sepia.ceph.com 2022-07-27T05:03:09.336 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-07-27T05:03:09.464 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi005 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_01:48:00-fs-wip-yuri6-testing-2022-07-26-1538-octopus-distro-default-smithi/6948787 2022-07-27T05:03:09.464 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi074 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-07-27_01:48:00-fs-wip-yuri6-testing-2022-07-26-1538-octopus-distro-default-smithi/6948787