2022-04-29T21:04:33.566 INFO:root:teuthology version: 1.1.1.dev328+g004701de 2022-04-29T21:04:33.701 INFO:teuthology.lock.ops:Start node 'smithi152.front.sepia.ceph.com' reimaging 2022-04-29T21:04:33.701 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: reset os type and version on server 2022-04-29T21:04:33.701 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-04-29T21:04:33.721 INFO:teuthology.lock.ops:Node 'smithi152.front.sepia.ceph.com' reimaging is complete 2022-04-29T21:04:33.721 INFO:teuthology.lock.ops:Start node 'smithi153.front.sepia.ceph.com' reimaging 2022-04-29T21:04:33.721 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: reset os type and version on server 2022-04-29T21:04:33.721 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-04-29T21:04:33.739 INFO:teuthology.lock.ops:Node 'smithi153.front.sepia.ceph.com' reimaging is complete 2022-04-29T21:04:33.933 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of centos 8.stream 2022-04-29T21:04:33.975 INFO:teuthology.provision.fog.smithi153:Scheduling deploy of centos 8.stream 2022-04-29T21:04:34.316 INFO:teuthology.orchestra.console:Power off smithi152 2022-04-29T21:04:34.364 INFO:teuthology.orchestra.console:Power off smithi153 2022-04-29T21:04:34.475 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-04-29T21:04:34.514 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-04-29T21:04:34.576 INFO:teuthology.orchestra.console:Power on smithi152 2022-04-29T21:04:34.615 INFO:teuthology.orchestra.console:Power on smithi153 2022-04-29T21:04:38.875 INFO:teuthology.orchestra.console:Power on for smithi153 completed 2022-04-29T21:04:38.976 INFO:teuthology.provision.fog.smithi153:Waiting for deploy to finish 2022-04-29T21:04:43.049 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2022-04-29T21:04:43.150 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2022-04-29T21:09:06.646 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-29T21:09:25.881 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-04-29T21:09:26.160 INFO:teuthology.provision.fog.smithi153:Node is ready 2022-04-29T21:09:26.178 INFO:teuthology.orchestra.run.smithi153.stdout:smithi153.front.sepia.ceph.com 2022-04-29T21:09:26.238 INFO:teuthology.orchestra.run.smithi153.stdout:172.21.15.153 smithi153.front.sepia.ceph.com smithi153 2022-04-29T21:09:26.598 INFO:teuthology.provision.fog.smithi153:Deploy complete! 2022-04-29T21:09:31.782 INFO:teuthology.provision.fog.smithi152:Node is ready 2022-04-29T21:09:31.811 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2022-04-29T21:09:31.870 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2022-04-29T21:09:32.237 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2022-04-29T21:09:32.406 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2022-04-29T21:09:32.407 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-29T21:09:32.425 INFO:teuthology.lock.ops:Checking smithi153.front.sepia.ceph.com 2022-04-29T21:09:32.425 INFO:teuthology.lock.ops:New key found. Updating... 2022-04-29T21:09:32.444 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2022-04-29T21:09:32.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-04-29T21:09:32.646 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2022-04-29T21:09:32.704 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2022-04-29T21:09:32.704 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2022-04-29T21:09:32.704 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2022-04-29T21:09:32.704 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-29T21:09:32.705 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-29T21:09:32.707 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-04-29T21:09:32.723 INFO:teuthology.lock.ops:Updating [smithi153.front.sepia.ceph.com]: set os type and version on server 2022-04-29T21:09:32.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-04-29T21:09:32.931 INFO:teuthology.orchestra.run.smithi153.stdout:x86_64 2022-04-29T21:09:32.990 INFO:teuthology.orchestra.run.smithi153.stdout:NAME="CentOS Stream" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION="8" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:ID="centos" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:ID_LIKE="rhel fedora" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:VERSION_ID="8" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:PLATFORM_ID="platform:el8" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:PRETTY_NAME="CentOS Stream 8" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:ANSI_COLOR="0;31" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:HOME_URL="https://centos.org/" 2022-04-29T21:09:32.991 INFO:teuthology.orchestra.run.smithi153.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-04-29T21:09:32.992 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-04-29T21:09:32.992 INFO:teuthology.orchestra.run.smithi153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-04-29T21:09:32.992 INFO:teuthology.lock.ops:Updating smithi153.front.sepia.ceph.com on lock server 2022-04-29T21:09:33.093 INFO:teuthology.dispatcher.supervisor:Running job 6812782 2022-04-29T21:09:33.093 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812782 --name amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812782/orig.config.yaml 2022-04-29T21:09:33.101 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-04-29_07:12:13-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6812782 2022-04-29T21:09:33.103 INFO:teuthology.dispatcher.supervisor:Job PID: 29076 2022-04-29T21:09:33.103 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-04-30T03:40:02.231 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-04-30T03:40:02.397 INFO:teuthology.kill:Killing Pids: {29076} 2022-04-30T03:40:03.957 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-04-30T03:40:03.957 INFO:teuthology.task.internal:roles: ubuntu@smithi153.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-04-30T03:40:03.957 INFO:teuthology.misc:Compressing logs... 2022-04-30T03:40:03.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-04-30T03:40:04.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi153.front.sepia.ceph.com' 2022-04-30T03:40:04.581 INFO:teuthology.misc:Compressing logs... 2022-04-30T03:40:05.013 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-30T03:40:05.118 INFO:teuthology.orchestra.run.smithi153.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-04-30T03:40:05.590 INFO:teuthology.misc:Compressing logs... 2022-04-30T03:40:14.093 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/ceph-client.admin.102449.log: file size changed while zipping 2022-04-30T03:40:34.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/ceph-osd.2.log: file size changed while zipping 2022-04-30T03:40:46.781 INFO:teuthology.kill:No teuthology processes running 2022-04-30T03:40:48.239 INFO:teuthology.kill:Nuking machines: ['smithi152', 'smithi153'] 2022-04-30T03:40:49.415 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-04-30T03:40:49.415 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-04-30T03:40:49.415 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_004701def07b67dd914d7b1775457fec6788a495/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-04-30T03:40:49.415 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-04-30T03:40:49.415 INFO:teuthology.kill:2022-04-30 03:40:49,414.414 INFO:teuthology.nuke:targets: 2022-04-30T03:40:49.416 INFO:teuthology.kill: smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC9MaqgaquUbl7xcGXJCaHolGLMS+aARrG3JLgRM2KN/eFa9YguonftqbabY+NDgqQVEzzeaHoWzubIPZ8rmGNkEe0Y4seisYwvFAF40cuCPiM03iT+yN6+9hL6pNnWrWvXqODjybWFNIc3/YlzUzBroUotDAkxrkx89DnG78yBQZ5r4hETo1vzbIg9V+r36Hm8USxBePEzrWp4E34e5gVL4TNHzSQZqzj2n2/CloZuydKppbY/CsZYPlWHlKYaUWZobkXhXD8Bj2aQUA35QS14vcAn7otAnM74yS6KaDZ3uEJTehoaAa+pse5VhC7CbdZp/h2rkplqBg+w0qyem7zxRxy31ytS+t7wyL9BH9DuFSbNu8jHipd3Us//gZJwd56nNRmU60VhctLWGK++N9bNz1VjtMGenrW3zgjXgCxqT4xTYzr7e+N+pxC+Svvx/6sa6DFqcujuPAiV4Xd3l/sZVeB0PCmwB8N6KOgeb4w3wLdu3wSRcmHSVO004za1LkE= 2022-04-30T03:40:49.416 INFO:teuthology.kill: smithi153.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD3rNux+Q4IOW2PJcxhcucYli9ckDGquAy23GIDDxgUlj4SUk4c2lcYlDKVGw/cp7n85WeVAhAgrh3nPntX30sXrWJok4Pr8GnSVsC7EYRLitNls3hXdNfRJX+AcOi+nx5RPlUTcesnsaP2jvqOB+wFFZb9FrjX4t8NGiZZYn0Pt9AmNx2Dv5un0amcw6Kpcv2/78vBaPuDS/qw+UybuU9+ZOwTv84qarSc2KL2PXI4brvCdmOI/iiefkjiyfRsuLHVycXgCp5+DtCV8ZjNcrbwQfv9dx9nJ5wfOxk5SoUWn+ne49BshtQkpIMz8YHftcuHqpCeS28cdTi/gALbsNzOLHqfJN/9VDYxzCIG9KifYsaIusC6WXbBTv/Ahej4EbNqW4sy7+UuUUA/dq5MFuHbTJuqs/bPfGoyOaRNPdY5sDjYYIa9AAHEgHpqEZ+z8ATUtv5WwbWZtPns7huUYN6b32bsPySDkOsGwDwh6FO5zS9Hw984zPGOe8QYBaorx5M= 2022-04-30T03:40:49.443 INFO:teuthology.kill:2022-04-30 03:40:49,442.442 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-30T03:40:49.483 INFO:teuthology.kill:2022-04-30 03:40:49,446.446 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-04-30T03:40:49.539 INFO:teuthology.kill:2022-04-30 03:40:49,538.538 INFO:teuthology.orchestra.console:Power off smithi152 2022-04-30T03:40:49.557 INFO:teuthology.kill:2022-04-30 03:40:49,557.557 INFO:teuthology.orchestra.console:Power off smithi153 2022-04-30T03:40:57.933 INFO:teuthology.kill:2022-04-30 03:40:57,932.932 INFO:teuthology.orchestra.console:Power off for smithi153 completed 2022-04-30T03:40:57.938 INFO:teuthology.kill:2022-04-30 03:40:57,938.938 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-04-30T03:40:58.081 INFO:teuthology.kill:2022-04-30 03:40:58,080.080 INFO:teuthology.lock.ops:unlocked: smithi152.front.sepia.ceph.com 2022-04-30T03:40:58.084 INFO:teuthology.kill:2022-04-30 03:40:58,084.084 INFO:teuthology.lock.ops:unlocked: smithi153.front.sepia.ceph.com 2022-04-30T03:42:58.400 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-04-30T03:42:58.503 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi152 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-30_00:22:23-rados-pacific-16.2.8_RC1-distro-default-smithi/6814449 2022-04-30T03:42:58.503 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi153 but it was locked by another job: /home/teuthworker/archive/yuriw-2022-04-30_00:22:23-rados-pacific-16.2.8_RC1-distro-default-smithi/6814449