2022-06-28T19:00:27.105 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T19:00:27.276 INFO:teuthology.lock.ops:Start node 'smithi161.front.sepia.ceph.com' reimaging 2022-06-28T19:00:27.277 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T19:00:27.277 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2022-06-28T19:00:27.302 INFO:teuthology.lock.ops:Node 'smithi161.front.sepia.ceph.com' reimaging is complete 2022-06-28T19:00:27.302 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging 2022-06-28T19:00:27.302 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server 2022-06-28T19:00:27.303 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-06-28T19:00:27.331 INFO:teuthology.lock.ops:Node 'smithi181.front.sepia.ceph.com' reimaging is complete 2022-06-28T19:00:27.533 INFO:teuthology.provision.fog.smithi161:Scheduling deploy of centos 8.stream 2022-06-28T19:00:27.561 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 8.stream 2022-06-28T19:00:27.906 INFO:teuthology.orchestra.console:Power off smithi161 2022-06-28T19:00:27.973 INFO:teuthology.orchestra.console:Power off smithi181 2022-06-28T19:00:36.344 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-06-28T19:00:36.446 INFO:teuthology.orchestra.console:Power on smithi181 2022-06-28T19:00:40.399 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2022-06-28T19:00:40.501 INFO:teuthology.orchestra.console:Power on smithi161 2022-06-28T19:00:44.808 INFO:teuthology.orchestra.console:Power on for smithi181 completed 2022-06-28T19:00:44.910 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish 2022-06-28T19:00:48.990 INFO:teuthology.orchestra.console:Power on for smithi161 completed 2022-06-28T19:00:49.091 INFO:teuthology.provision.fog.smithi161:Waiting for deploy to finish 2022-06-28T19:04:51.030 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T19:05:15.952 INFO:teuthology.provision.fog.smithi181:Node is ready 2022-06-28T19:05:15.973 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com 2022-06-28T19:05:16.032 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181 2022-06-28T19:05:16.420 INFO:teuthology.provision.fog.smithi181:Deploy complete! 2022-06-28T19:05:29.749 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-06-28T19:05:30.067 INFO:teuthology.provision.fog.smithi161:Node is ready 2022-06-28T19:05:30.088 INFO:teuthology.orchestra.run.smithi161.stdout:smithi161.front.sepia.ceph.com 2022-06-28T19:05:30.149 INFO:teuthology.orchestra.run.smithi161.stdout:172.21.15.161 smithi161.front.sepia.ceph.com smithi161 2022-06-28T19:05:30.531 INFO:teuthology.provision.fog.smithi161:Deploy complete! 2022-06-28T19:05:30.722 INFO:teuthology.lock.ops:Checking smithi161.front.sepia.ceph.com 2022-06-28T19:05:30.723 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T19:05:30.745 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com 2022-06-28T19:05:30.745 INFO:teuthology.lock.ops:New key found. Updating... 2022-06-28T19:05:30.767 INFO:teuthology.lock.ops:Updating [smithi161.front.sepia.ceph.com]: set os type and version on server 2022-06-28T19:05:30.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2022-06-28T19:05:30.974 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2022-06-28T19:05:31.031 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2022-06-28T19:05:31.032 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="8" 2022-06-28T19:05:31.032 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2022-06-28T19:05:31.032 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2022-06-28T19:05:31.033 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="8" 2022-06-28T19:05:31.033 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el8" 2022-06-28T19:05:31.033 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T19:05:31.033 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2022-06-28T19:05:31.034 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T19:05:31.034 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2022-06-28T19:05:31.035 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T19:05:31.035 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T19:05:31.035 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T19:05:31.037 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2022-06-28T19:05:31.058 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server 2022-06-28T19:05:31.059 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2022-06-28T19:05:31.332 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64 2022-06-28T19:05:31.390 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream" 2022-06-28T19:05:31.391 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="8" 2022-06-28T19:05:31.391 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos" 2022-06-28T19:05:31.391 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora" 2022-06-28T19:05:31.392 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="8" 2022-06-28T19:05:31.392 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el8" 2022-06-28T19:05:31.392 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 8" 2022-06-28T19:05:31.392 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31" 2022-06-28T19:05:31.393 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-06-28T19:05:31.393 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/" 2022-06-28T19:05:31.393 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-06-28T19:05:31.394 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-06-28T19:05:31.394 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-06-28T19:05:31.394 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server 2022-06-28T19:05:31.524 INFO:teuthology.dispatcher.supervisor:Running job 6901705 2022-06-28T19:05:31.524 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901705 --name lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi --description rados:thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} -- /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901705/orig.config.yaml 2022-06-28T19:05:31.530 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-06-27_23:44:12-rados:thrash-erasure-code-wip-yuri2-testing-2022-04-26-1132-octopus-distro-default-smithi/6901705 2022-06-28T19:05:31.531 INFO:teuthology.dispatcher.supervisor:Job PID: 26524 2022-06-28T19:05:31.531 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-06-29T07:07:13.597 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2022-06-29T07:07:14.392 INFO:teuthology.kill:Killing Pids: {26524} 2022-06-29T07:07:16.258 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-06-29T07:07:16.261 INFO:teuthology.task.internal:roles: ubuntu@smithi181.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-06-29T07:07:16.268 INFO:teuthology.misc:Compressing logs... 2022-06-29T07:07:16.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2022-06-29T07:07:17.464 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com' 2022-06-29T07:07:18.211 INFO:teuthology.orchestra.run.smithi181.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T07:07:18.320 INFO:teuthology.orchestra.run.smithi161.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-06-29T07:07:19.291 INFO:teuthology.kill:No teuthology processes running 2022-06-29T07:07:21.058 INFO:teuthology.kill:Nuking machines: ['smithi161', 'smithi181'] 2022-06-29T07:07:22.398 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_082ae7ef4302fa54665ed0a2535e8e254118dcfd/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-06-29T07:07:22.399 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-06-29T07:07:22.400 INFO:teuthology.kill:2022-06-29 07:07:22,397.397 INFO:teuthology.nuke:targets: 2022-06-29T07:07:22.400 INFO:teuthology.kill: smithi161.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDZjQYAeR9JDiL5uiHoxzkInBKlmCNd+J5uow9NxvEmSh1nt45bMks+EtsHhnMzZsy390Lgcs5yfKgt5GaRWcSGAQLXtcIz44TpjykP0E8FVotrPOrVfuAj07+CCUCMAc0Fdc9ppKo5U3r8J+h10uDGpueLCPQEdJqJ2TPZYWmP+soyiBKnpZotVxmf0jJYB/HWHtjmM9w94nBPzQIuKJl/Y5EP5rmgmOulmolu84klDbMHT6fvCG5RweolwZIBcBbab5DHwg3uz331KSX9Re5HpBrbGVVpMM+PtbqFIjtmpiG1aZ3NrDX2W5FqWXPwsfwKU93DPOPPFDpCI7anOfL7pjPmcyHgxAKhXuOSvRYPJCka8992wp3ZfIpB88N+bmu+zQYYh7/Ml0TbCtEx8U4ElDWVB+Y71rJIauC4GrOIJTSdcDBmRqvXzUuJas0hhhzkVtAuJNOvhAET3CR6h0wLKLVGjx7mRtcjmlpkrq3U+cPohWmTupnpoFVb8lW+DXk= 2022-06-29T07:07:22.401 INFO:teuthology.kill: smithi181.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDIExQfPdGe1ZcMsw9GkZZw3cgC9c9CphF1OFBsGbjpTO76f6Rvq/qry/6blK0hCwxkJFkEq/OZ313jehxOncSH8yhp+FIcrYyQj99e534p5KEndBts9RTTDTs7Y8cBR+ffFnYzwRdxyvqwQJuB1fa/t0dIm+BZunSfs8V+9+jpAyvNZ97Kd0W3Pzs9mOVVEcqkgO5VR6eleRJ0QXtV9YsC4yAO03XRdYpq4146fAdwh2WJUigp7Lo/WqXIA2q3woZOXHlp5mlVJiSWKkyFfNRAyaGDXDQemPYI5TaZgevwrLZ/MgpyDAcRDr/Q7/ylK8kDpOstnhJagluBsXzVKRHOg5mOT3k+JD3dPD7UaJdvN7Xeqz+pxZHahN7t4ByaZbAh7W7vvCbbb5wQzPhEDNnGEFT0NDjv1WE/MZO5wpt9ik0EScxzKWzaqrbtgP7s6U99ICav/zzm4Bzn/qLQArNU+HKCqmoSBsNX7qftPujInLmABBar2YCTwf832ibVIq0= 2022-06-29T07:07:22.407 INFO:teuthology.kill:2022-06-29 07:07:22,397.397 INFO:teuthology.nuke:Checking targets against current locks 2022-06-29T07:07:22.493 INFO:teuthology.kill:2022-06-29 07:07:22,492.492 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T07:07:22.550 INFO:teuthology.kill:2022-06-29 07:07:22,549.549 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-06-29T07:07:22.628 INFO:teuthology.kill:2022-06-29 07:07:22,627.627 INFO:teuthology.orchestra.console:Power off smithi161 2022-06-29T07:07:22.731 INFO:teuthology.kill:2022-06-29 07:07:22,731.731 INFO:teuthology.orchestra.console:Power off smithi181 2022-06-29T07:07:35.157 INFO:teuthology.kill:2022-06-29 07:07:35,156.156 INFO:teuthology.orchestra.console:Power off for smithi161 completed 2022-06-29T07:07:35.230 INFO:teuthology.kill:2022-06-29 07:07:35,230.230 INFO:teuthology.orchestra.console:Power off for smithi181 completed 2022-06-29T07:07:35.312 INFO:teuthology.kill:2022-06-29 07:07:35,312.312 INFO:teuthology.lock.ops:unlocked: smithi161.front.sepia.ceph.com 2022-06-29T07:07:35.384 INFO:teuthology.kill:2022-06-29 07:07:35,384.384 INFO:teuthology.lock.ops:unlocked: smithi181.front.sepia.ceph.com 2022-06-29T07:09:35.772 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-06-29T07:09:35.928 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/dis-2022-06-29_07:05:22-rbd-wip-dis-testing-2-distro-default-smithi/6904689